Preprint · 2025 · Open access

Bayesian Optimization with Expected Improvement: No Regret and the Choice of Incumbent

Jingyi Wang, Wang, Haowei, Szu Hui Ng, Cosmin G. Petra

arXiv (Cornell University) · Published 21 August 2025 · DOI 10.48550/arxiv.2508.15674

Open PDFView at the publisherCite this paper

In brief

“Bayesian Optimization with Expected Improvement: No Regret and the Choice of Incumbent” is a 2025 preprint by Jingyi Wang and 3 co-authors, published in arXiv (Cornell University). OpenAlex counts 1 citations as of 19 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).

Citations
1
Most cited in
2026 (1)
References
25
Authors
4

Abstract

Expected improvement (EI) is one of the most widely used acquisition functions in Bayesian optimization (BO). Despite its proven empirical success in applications, the cumulative regret upper bound of EI remains an open question. In this paper, we analyze the classic noisy Gaussian process expected improvement (GP-EI) algorithm. We consider the Bayesian setting, where the objective is a sample from a GP. Three commonly used incumbents, namely the best posterior mean incumbent (BPMI), the best sampled posterior mean incumbent (BSPMI), and the best observation incumbent (BOI) are considered as the choices of the current best value in GP-EI. We present for the first time the cumulative regret upper bounds of GP-EI with BPMI and BSPMI. Importantly, we show that in both cases, GP-EI is a no-regret algorithm for both squared exponential (SE) and Matérn kernels. Further, we present for the first time that GP-EI with BOI either achieves a sublinear cumulative regret upper bound or has a fast converging noisy simple regret bound for SE and Matérn kernels. Our results provide theoretical guidance to the choice of incumbent when practitioners apply GP-EI in the noisy setting. Numerical experiments are conducted to validate our findings.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Wang, J., Haowei, W., Ng, S. H., & Petra, C. G. (2025). Bayesian Optimization with Expected Improvement: No Regret and the Choice of Incumbent. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2508.15674

MLA 9

Wang, Jingyi, et al. “Bayesian Optimization with Expected Improvement: No Regret and the Choice of Incumbent.” arXiv (Cornell University), 2025. https://doi.org/10.48550/arxiv.2508.15674.

Chicago

Wang, Jingyi, Wang, Haowei, Szu Hui Ng, and Cosmin G. Petra. 2025. “Bayesian Optimization with Expected Improvement: No Regret and the Choice of Incumbent.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.2508.15674.

Harvard

Wang, J. et al. (2025) ‘Bayesian Optimization with Expected Improvement: No Regret and the Choice of Incumbent’, arXiv (Cornell University). doi:10.48550/arxiv.2508.15674.

IEEE

J. Wang, W. Haowei, S. H. Ng, and C. G. Petra, “Bayesian Optimization with Expected Improvement: No Regret and the Choice of Incumbent,” arXiv (Cornell University), 2025, doi: 10.48550/arxiv.2508.15674.

BibTeX

@misc{wang2025bayesian,
  title     = {{Bayesian Optimization with Expected Improvement: No Regret and the Choice of Incumbent}},
  author    = {Wang, Jingyi and Haowei, Wang, and Ng, Szu Hui and Petra, Cosmin G.},
  howpublished = {arXiv (Cornell University)},
  year      = {2025},
  doi       = {10.48550/arxiv.2508.15674},
  url       = {https://doi.org/10.48550/arxiv.2508.15674}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research

  • Bayesian optimization
  • expected improvement
  • acquisition functions
  • no-regret algorithms
  • Matérn kernel
  • Gaussian kernel

Work with this paper

Most-cited papers in Decision Sciences

All highly cited Decision Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Wang, J., Haowei, W., Ng, S. H., & Petra, C. G. (2025). Bayesian Optimization with Expected Improvement: No Regret and the Choice of Incumbent. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2508.15674

How many times has this paper been cited?

1 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

Jingyi Wang, Wang, Haowei, Szu Hui Ng, Cosmin G. Petra.

What is the DOI of this paper?

10.48550/arxiv.2508.15674, permanently at https://doi.org/10.48550/arxiv.2508.15674. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.