Preprint · 2018 · Open access

A Tutorial on Bayesian Optimization

Peter I. Frazier

arXiv (Cornell University) · Published 8 July 2018 · DOI 10.48550/arxiv.1807.02811

Open PDFView at the publisherCite this paper

In brief

“A Tutorial on Bayesian Optimization” is a 2018 preprint by Peter I. Frazier, published in arXiv (Cornell University). OpenAlex counts 3,610 citations as of 19 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).

Citations
3,610
Most cited in
2025 (764)
References
100
Authors
1

Abstract

Bayesian optimization is an approach to optimizing objective functions that take a long time (minutes or hours) to evaluate. It is best-suited for optimization over continuous domains of less than 20 dimensions, and tolerates stochastic noise in function evaluations. It builds a surrogate for the objective and quantifies the uncertainty in that surrogate using a Bayesian machine learning technique, Gaussian process regression, and then uses an acquisition function defined from this surrogate to decide where to sample. In this tutorial, we describe how Bayesian optimization works, including Gaussian process regression and three common acquisition functions: expected improvement, entropy search, and knowledge gradient. We then discuss more advanced techniques, including running multiple function evaluations in parallel, multi-fidelity and multi-information source optimization, expensive-to-evaluate constraints, random environmental conditions, multi-task Bayesian optimization, and the inclusion of derivative information. We conclude with a discussion of Bayesian optimization software and future research directions in the field. Within our tutorial material we provide a generalization of expected improvement to noisy evaluations, beyond the noise-free setting where it is more commonly applied. This generalization is justified by a formal decision-theoretic argument, standing in contrast to previous ad hoc modifications.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Frazier, P. I. (2018). A Tutorial on Bayesian Optimization. arXiv (Cornell University). https://doi.org/10.48550/arxiv.1807.02811

MLA 9

Frazier, Peter I. “A Tutorial on Bayesian Optimization.” arXiv (Cornell University), 2018. https://doi.org/10.48550/arxiv.1807.02811.

Chicago

Frazier, Peter I. 2018. “A Tutorial on Bayesian Optimization.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.1807.02811.

Harvard

Frazier, P. I. (2018) ‘A Tutorial on Bayesian Optimization’, arXiv (Cornell University). doi:10.48550/arxiv.1807.02811.

IEEE

P. I. Frazier, “A Tutorial on Bayesian Optimization,” arXiv (Cornell University), 2018, doi: 10.48550/arxiv.1807.02811.

BibTeX

@misc{frazier2018tutorial,
  title     = {{A Tutorial on Bayesian Optimization}},
  author    = {Frazier, Peter I.},
  howpublished = {arXiv (Cornell University)},
  year      = {2018},
  doi       = {10.48550/arxiv.1807.02811},
  url       = {https://doi.org/10.48550/arxiv.1807.02811}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
201877
20198181
2020194194
2021310310
2022366366
2023498498
2024632632
2025764764
2026757757

Topic and keywords

Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research

  • Bayesian optimization
  • Gaussian process regression
  • acquisition functions
  • expected improvement
  • knowledge gradient
  • noisy function evaluations
  • surrogate models
  • multi-fidelity optimization

Work with this paper

Most-cited papers in Decision Sciences

All highly cited Decision Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Frazier, P. I. (2018). A Tutorial on Bayesian Optimization. arXiv (Cornell University). https://doi.org/10.48550/arxiv.1807.02811

How many times has this paper been cited?

3,610 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

Peter I. Frazier.

What is the DOI of this paper?

10.48550/arxiv.1807.02811, permanently at https://doi.org/10.48550/arxiv.1807.02811. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.