Preprint · 2021 · Open access
Batch Multi-Fidelity Bayesian Optimization with Deep Auto-Regressive Networks
arXiv (Cornell University) · Published 18 June 2021 · DOI 10.48550/arxiv.2106.09884
In brief
“Batch Multi-Fidelity Bayesian Optimization with Deep Auto-Regressive Networks” is a 2021 preprint by Shibo Li and 2 co-authors, published in arXiv (Cornell University). OpenAlex counts 10 citations as of 19 November 2026. It is open access under a CC BY licence: the full text is free to read at arXiv (Cornell University).
- Citations
- 10
- Most cited in
- 2023 (5)
- References
- 67
- Authors
- 3
Abstract
Bayesian optimization (BO) is a powerful approach for optimizing black-box, expensive-to-evaluate functions. To enable a flexible trade-off between the cost and accuracy, many applications allow the function to be evaluated at different fidelities. In order to reduce the optimization cost while maximizing the benefit-cost ratio, in this paper, we propose Batch Multi-fidelity Bayesian Optimization with Deep Auto-Regressive Networks (BMBO-DARN). We use a set of Bayesian neural networks to construct a fully auto-regressive model, which is expressive enough to capture strong yet complex relationships across all the fidelities, so as to improve the surrogate learning and optimization performance. Furthermore, to enhance the quality and diversity of queries, we develop a simple yet efficient batch querying method, without any combinatorial search over the fidelities. We propose a batch acquisition function based on Max-value Entropy Search (MES) principle, which penalizes highly correlated queries and encourages diversity. We use posterior samples and moment matching to fulfill efficient computation of the acquisition function and conduct alternating optimization over every fidelity-input pair, which guarantees an improvement at each step. We demonstrate the advantage of our approach on four real-world hyperparameter optimization applications.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Li, S., Kirby, R. M., & Zhe, S. (2021). Batch Multi-Fidelity Bayesian Optimization with Deep Auto-Regressive Networks. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2106.09884
MLA 9
Li, Shibo, et al. “Batch Multi-Fidelity Bayesian Optimization with Deep Auto-Regressive Networks.” arXiv (Cornell University), 2021. https://doi.org/10.48550/arxiv.2106.09884.
Chicago
Li, Shibo, Robert M. Kirby, and Shandian Zhe. 2021. “Batch Multi-Fidelity Bayesian Optimization with Deep Auto-Regressive Networks.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.2106.09884.
Harvard
Li, S., Kirby, R. M. and Zhe, S. (2021) ‘Batch Multi-Fidelity Bayesian Optimization with Deep Auto-Regressive Networks’, arXiv (Cornell University). doi:10.48550/arxiv.2106.09884.
IEEE
S. Li, R. M. Kirby, and S. Zhe, “Batch Multi-Fidelity Bayesian Optimization with Deep Auto-Regressive Networks,” arXiv (Cornell University), 2021, doi: 10.48550/arxiv.2106.09884.
BibTeX
@misc{li2021batch,
title = {{Batch Multi-Fidelity Bayesian Optimization with Deep Auto-Regressive Networks}},
author = {Li, Shibo and Kirby, Robert M. and Zhe, Shandian},
howpublished = {arXiv (Cornell University)},
year = {2021},
doi = {10.48550/arxiv.2106.09884},
url = {https://doi.org/10.48550/arxiv.2106.09884}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2022 | 2 | |
| 2023 | 5 | |
| 2024 | 2 | |
| 2025 | 1 |
Topic and keywords
Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
- multi-fidelity Bayesian optimization
- batch Bayesian optimization
- Bayesian neural networks
- moment matching
- hyperparameter optimization
- surrogate models
Work with this paper
Most-cited papers in Decision Sciences
- The PRISMA 2020 statement: an updated guideline for reporting systematic reviewsMatthew James Page, Joanne E. McKenzie, Patrick M. Bossuyt and 23 more · BMJ · 2021 · 144,919 citations
- Evaluating Structural Equation Models with Unobservable Variables and Measurement ErrorClaes Fornell, David F. Larcker · Journal of Marketing Research · 1981 · 118,336 citations
- Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternativesLi‐tze Hu, Peter M. Bentler · Structural Equation Modeling A Multidisciplinary Journal · 1999 · 117,461 citations
- Common method biases in behavioral research: A critical review of the literature and recommended remedies.Philip M. Podsakoff, SCOTT B. MACKENZIE, Jeong Yeon Lee and 1 more · Journal of Applied Psychology · 2003 · 89,248 citations
- Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statementDavid Moher, Alessandro Liberati, Jennifer Tetzlaff and 2 more · BMJ · 2009 · 85,524 citations
Questions about this paper
How do I cite this paper in APA style?
Li, S., Kirby, R. M., & Zhe, S. (2021). Batch Multi-Fidelity Bayesian Optimization with Deep Auto-Regressive Networks. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2106.09884
How many times has this paper been cited?
10 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.
Who wrote this paper?
Shibo Li, Robert M. Kirby, Shandian Zhe.
What is the DOI of this paper?
10.48550/arxiv.2106.09884, permanently at https://doi.org/10.48550/arxiv.2106.09884. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.