Dissertation · 2018 · Open access

Optimizing Bayesian optimization

Mark McLeod

Oxford University Research Archive (ORA) (University of Oxford) · Published 1 January 2018 · DOI 10.5287/ora-b7xonydqo

Open PDFView at the publisherCite this paper

In brief

“Optimizing Bayesian optimization” is a 2018 dissertation by Mark McLeod, published in Oxford University Research Archive (ORA) (University of Oxford). OpenAlex counts 0 citations as of 19 November 2026. It is open access: the full text is free to read at Oxford University Research Archive (ORA) (University of Oxford).

Citations
0
References
49
Authors
1

Abstract

We are concerned primarily with improving the practical applicability of Bayesian optimization. We make contributions in three key areas. We develop an intuitive online stopping criterion, allowing only as many steps as necessary to achieve the desired target to be taken. By combining this with intelligent online switching between acquisition functions and pure local optimization we are also able to substantially improve convergence to the local minimum associated with our final solution. In cases where a continuum of reduced cost, but also reduced accuracy, evaluations are available we develop a Bayesian Optimization acquisition function to select both the location and cost of each evaluation. We achieve this with lower overheads than previous methods, translating to a real increase in performance. Part of this improvement is achieved by way of a new, more efficient, method for generating support points to sample the minimum of a Gaussian process. Further, in the case that the reduced cost estimates are unbiased we show that a practical solution cannot exist in most cases without also taking into consideration both computational overheads and a restriction on available resources. Given this knowledge we then develop a method which provides a viable solution in this setting. Finally, we outline practical implementation details for Bayesian optimization which allow substantial reductions in the overhead costs without changing the theoretical properties of optimization. This is primarily achieved by use of adaptive quadrature to marginalize Gaussian process hyperparameters in place of the more common slice sampling approach.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

McLeod, M. (2018). Optimizing Bayesian optimization. Oxford University Research Archive (ORA) (University of Oxford). https://doi.org/10.5287/ora-b7xonydqo

MLA 9

McLeod, Mark. “Optimizing Bayesian optimization.” Oxford University Research Archive (ORA) (University of Oxford), 2018. https://doi.org/10.5287/ora-b7xonydqo.

Chicago

McLeod, Mark. 2018. “Optimizing Bayesian optimization.” Oxford University Research Archive (ORA) (University of Oxford). https://doi.org/10.5287/ora-b7xonydqo.

Harvard

McLeod, M. (2018) ‘Optimizing Bayesian optimization’, Oxford University Research Archive (ORA) (University of Oxford). doi:10.5287/ora-b7xonydqo.

IEEE

M. McLeod, “Optimizing Bayesian optimization,” Oxford University Research Archive (ORA) (University of Oxford), 2018, doi: 10.5287/ora-b7xonydqo.

BibTeX

@phdthesis{mcleod2018optimizing,
  title     = {{Optimizing Bayesian optimization}},
  author    = {McLeod, Mark},
  year      = {2018},
  doi       = {10.5287/ora-b7xonydqo},
  url       = {https://doi.org/10.5287/ora-b7xonydqo}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research

  • Bayesian optimization
  • acquisition functions
  • local optimization
  • adaptive quadrature
  • slice sampling
  • computational overhead reduction

Work with this paper

Most-cited papers in Decision Sciences

All highly cited Decision Sciences papers

Questions about this paper

How do I cite this paper in APA style?

McLeod, M. (2018). Optimizing Bayesian optimization. Oxford University Research Archive (ORA) (University of Oxford). https://doi.org/10.5287/ora-b7xonydqo

How many times has this paper been cited?

0 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at Oxford University Research Archive (ORA) (University of Oxford): sign in and open the PDF from this page.

Who wrote this paper?

Mark McLeod.

What is the DOI of this paper?

10.5287/ora-b7xonydqo, permanently at https://doi.org/10.5287/ora-b7xonydqo. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.