Preprint · 2025 · Open access
Bayesian Optimization with Expected Improvement: No Regret and the Choice of Incumbent
arXiv (Cornell University) · Published 21 August 2025 · DOI 10.48550/arxiv.2508.15674
In brief
“Bayesian Optimization with Expected Improvement: No Regret and the Choice of Incumbent” is a 2025 preprint by Jingyi Wang and 3 co-authors, published in arXiv (Cornell University). OpenAlex counts 1 citations as of 19 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).
- Citations
- 1
- Most cited in
- 2026 (1)
- References
- 25
- Authors
- 4
Abstract
Expected improvement (EI) is one of the most widely used acquisition functions in Bayesian optimization (BO). Despite its proven empirical success in applications, the cumulative regret upper bound of EI remains an open question. In this paper, we analyze the classic noisy Gaussian process expected improvement (GP-EI) algorithm. We consider the Bayesian setting, where the objective is a sample from a GP. Three commonly used incumbents, namely the best posterior mean incumbent (BPMI), the best sampled posterior mean incumbent (BSPMI), and the best observation incumbent (BOI) are considered as the choices of the current best value in GP-EI. We present for the first time the cumulative regret upper bounds of GP-EI with BPMI and BSPMI. Importantly, we show that in both cases, GP-EI is a no-regret algorithm for both squared exponential (SE) and Matérn kernels. Further, we present for the first time that GP-EI with BOI either achieves a sublinear cumulative regret upper bound or has a fast converging noisy simple regret bound for SE and Matérn kernels. Our results provide theoretical guidance to the choice of incumbent when practitioners apply GP-EI in the noisy setting. Numerical experiments are conducted to validate our findings.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Wang, J., Haowei, W., Ng, S. H., & Petra, C. G. (2025). Bayesian Optimization with Expected Improvement: No Regret and the Choice of Incumbent. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2508.15674
MLA 9
Wang, Jingyi, et al. “Bayesian Optimization with Expected Improvement: No Regret and the Choice of Incumbent.” arXiv (Cornell University), 2025. https://doi.org/10.48550/arxiv.2508.15674.
Chicago
Wang, Jingyi, Wang, Haowei, Szu Hui Ng, and Cosmin G. Petra. 2025. “Bayesian Optimization with Expected Improvement: No Regret and the Choice of Incumbent.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.2508.15674.
Harvard
Wang, J. et al. (2025) ‘Bayesian Optimization with Expected Improvement: No Regret and the Choice of Incumbent’, arXiv (Cornell University). doi:10.48550/arxiv.2508.15674.
IEEE
J. Wang, W. Haowei, S. H. Ng, and C. G. Petra, “Bayesian Optimization with Expected Improvement: No Regret and the Choice of Incumbent,” arXiv (Cornell University), 2025, doi: 10.48550/arxiv.2508.15674.
BibTeX
@misc{wang2025bayesian,
title = {{Bayesian Optimization with Expected Improvement: No Regret and the Choice of Incumbent}},
author = {Wang, Jingyi and Haowei, Wang, and Ng, Szu Hui and Petra, Cosmin G.},
howpublished = {arXiv (Cornell University)},
year = {2025},
doi = {10.48550/arxiv.2508.15674},
url = {https://doi.org/10.48550/arxiv.2508.15674}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
- Bayesian optimization
- expected improvement
- acquisition functions
- no-regret algorithms
- Matérn kernel
- Gaussian kernel
Work with this paper
Most-cited papers in Decision Sciences
- The PRISMA 2020 statement: an updated guideline for reporting systematic reviewsMatthew James Page, Joanne E. McKenzie, Patrick M. Bossuyt and 23 more · BMJ · 2021 · 144,919 citations
- Evaluating Structural Equation Models with Unobservable Variables and Measurement ErrorClaes Fornell, David F. Larcker · Journal of Marketing Research · 1981 · 118,336 citations
- Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternativesLi‐tze Hu, Peter M. Bentler · Structural Equation Modeling A Multidisciplinary Journal · 1999 · 117,461 citations
- Common method biases in behavioral research: A critical review of the literature and recommended remedies.Philip M. Podsakoff, SCOTT B. MACKENZIE, Jeong Yeon Lee and 1 more · Journal of Applied Psychology · 2003 · 89,248 citations
- Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statementDavid Moher, Alessandro Liberati, Jennifer Tetzlaff and 2 more · BMJ · 2009 · 85,524 citations
Questions about this paper
How do I cite this paper in APA style?
Wang, J., Haowei, W., Ng, S. H., & Petra, C. G. (2025). Bayesian Optimization with Expected Improvement: No Regret and the Choice of Incumbent. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2508.15674
How many times has this paper been cited?
1 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.
Who wrote this paper?
Jingyi Wang, Wang, Haowei, Szu Hui Ng, Cosmin G. Petra.
What is the DOI of this paper?
10.48550/arxiv.2508.15674, permanently at https://doi.org/10.48550/arxiv.2508.15674. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.