Scalable Batch Bayesian Optimization Via Subspace Acquisition Functions
- company arXiv
- location arXivLabs
- person Dawei Zhan
A new batch Bayesian optimization method that scales to large batch sizes by sampling from axis-aligned subspaces has been posted to the arXiv preprint server. The approach, proposed by Dawei Zhan, sidesteps a known degradation in efficiency that afflicts many existing batch methods as batch size grows [1][2]. Bayesian optimization is a machine learning technique rooted in statistical and mathematical optimization methods [3]. Extending it to evaluate multiple candidates in parallel can exploit modern parallel computing hardware, but most current batch approaches lose efficiency when the batch size increases [1][2]. The new work introduces a different strategy: rather than optimizing over the full problem space for every point in a batch, it draws a batch of axis-aligned subspaces and selects one candidate from each subspace using standard acquisition functions [1][2]. Numerical experiments reported in the paper indicate that the subspace method converges significantly faster than sequential Bayesian optimization and performs competitively against ten existing batch algorithms [1][2]. The implementation has been made publicly available on GitHub [2]. The manuscript was submitted to arXiv on 25 November 2024 and revised twice, with the latest version posted on 17 June 2026 [1]. arXiv, which began operating in 1991, is an open-access repository that hosts preprints across physics, mathematics, computer science, and related fields, and now receives roughly 24,000 new articles per month [8]. The paper appears under the machine learning category (cs.LG) and is accessible through standard arXiv abstract pages, which also offer community-built tools such as Bibliographic Explorer and CORE Recommender via the arXivLabs framework [1][6][7].
model-releaseresearch-paperproduct-launchtool-release
Background sources we checked (9)
- arxiv.org ↗ Extending Bayesian optimization to batch evaluation can enable the designer to make the most use of parallel computing technology. However, most of current batch approaches do not scale well with the batch size. That is, their optimization efficiencies often deteriorate as the ba…
- en.wikipedia.org ↗ Machine learning (ML) is a field of study in artificial intelligence concerned with the development and study of statistical algorithms that can learn from data and generalize to unseen data, and thus perform tasks without being explicitly programmed. Advances in the field of de…
- en.wikipedia.org ↗ This glossary of artificial intelligence is a list of definitions of terms and concepts relevant to the study of artificial intelligence (AI), its subdisciplines, and related fields. Related glossaries include Glossary of computer science, Glossary of robotics, Glossary of machin…
- info.arxiv.org ↗ arXiv Labs - arXiv info | arXiv e-print repository Skip to content # arXiv Labs Attention arXiv Users: arXiv Labs is pausing new proposals ## What are arXiv Labs? arXiv Labs are a way for the community to contribute new, useful features to arXiv. These integrations are avail…
- blog.arxiv.org ↗ arXivLabs: a space for community innovation – arXiv blog arXiv has launched a new, formalized framework enabling innovative collaborations with individuals and organizations. “Members of our community want to contribute tools that enhance the arXiv experience, and we val…
- info.arxiv.org ↗ arXivLabs: Showcase - arXiv info | arXiv e-print repository ... # arXivLabs: Showcase ... arXiv is surrounded by a community of researchers and developers working at the cutting edge of information science and technology. ... While the arXiv team is focused on our core mission—pr…
- en.wikipedia.org ↗ arXiv (pronounced as "archive"—the X represents the Greek letter chi ⟨χ⟩) is an open-access repository of electronic preprints and postprints (known as e-prints) approved for posting after moderation, but not peer reviewed. It consists of scientific papers in the fields of mathem…
- en.wikipedia.org ↗ 14 (fourteen) is the natural number following 13 and preceding 15.…
- en.wikipedia.org ↗ A large language model (LLM) is a type of machine learning model designed for natural language processing tasks such as language generation. LLMs are language models with many parameters, and are trained with self-supervised learning on a vast amount of text.…
Sources
- export.arxiv.org — Scalable Batch Bayesian Optimization Via Subspace Acquisition Functions ↗