Dissertation · 2016 · Open access

Practical Bayesian optimization with application to tuning machine learning algorithms

Bobak Shahriari

cIRcle (University of British Columbia) · Published 1 January 2016 · DOI 10.14288/1.0314167

Open full textView at the publisherCite this paper

In brief

“Practical Bayesian optimization with application to tuning machine learning algorithms” is a 2016 dissertation by Bobak Shahriari, published in cIRcle (University of British Columbia). OpenAlex counts 8 citations as of 19 November 2026. It is open access under a CC BY licence: the full text is free to read at cIRcle (University of British Columbia).

Citations
8
Most cited in
2026 (3)
References
75
Authors
1

Abstract

Bayesian optimization has recently emerged in the machine learning community as a very effective automatic alternative to the tedious task of hand-tuning algorithm hyperparameters. Although it is a relatively new aspect of machine learning, it has known roots in the Bayesian experimental design (Lindley, 1956; Chaloner and Verdinelli, 1995), the design and analysis of computer experiments (DACE; Sacks et al., 1989), Kriging (Krige, 1951), and multi-armed bandits (Gittins, 1979). In this thesis, we motivate and introduce the model-based optimization framework and provide some historical context to the technique that dates back as far as 1933 with application to clinical drug trials (Thompson, 1933). Contributions of this work include a Bayesian gap-based exploration policy, inspired by Gabillon et al. (2012); a principled information-theoretic portfolio strategy, out-performing the portfolio of Hoffman et al. (2011); and a general practical technique circumventing the need for an initial bounding box. These various works each address existing practical challenges in the way of more widespread adoption of probabilistic model-based optimization techniques. Finally, we conclude this thesis with important directions for future research, emphasizing scalability and computational feasibility of the approach as a general purpose optimizer.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Shahriari, B. (2016). Practical Bayesian optimization with application to tuning machine learning algorithms. cIRcle (University of British Columbia). https://doi.org/10.14288/1.0314167

MLA 9

Shahriari, Bobak. “Practical Bayesian optimization with application to tuning machine learning algorithms.” cIRcle (University of British Columbia), 2016. https://doi.org/10.14288/1.0314167.

Chicago

Shahriari, Bobak. 2016. “Practical Bayesian optimization with application to tuning machine learning algorithms.” cIRcle (University of British Columbia). https://doi.org/10.14288/1.0314167.

Harvard

Shahriari, B. (2016) ‘Practical Bayesian optimization with application to tuning machine learning algorithms’, cIRcle (University of British Columbia). doi:10.14288/1.0314167.

IEEE

B. Shahriari, “Practical Bayesian optimization with application to tuning machine learning algorithms,” cIRcle (University of British Columbia), 2016, doi: 10.14288/1.0314167.

BibTeX

@phdthesis{shahriari2016practical,
  title     = {{Practical Bayesian optimization with application to tuning machine learning algorithms}},
  author    = {Shahriari, Bobak},
  year      = {2016},
  doi       = {10.14288/1.0314167},
  url       = {https://doi.org/10.14288/1.0314167}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
201711
202011
202122
202511
202633

Topic and keywords

Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research

  • Bayesian optimization
  • hyperparameter optimization
  • model-based optimization
  • kriging
  • multi-armed bandits
  • Bayesian experimental design
  • computer experiments
  • Thompson sampling

Work with this paper

Most-cited papers in Decision Sciences

All highly cited Decision Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Shahriari, B. (2016). Practical Bayesian optimization with application to tuning machine learning algorithms. cIRcle (University of British Columbia). https://doi.org/10.14288/1.0314167

How many times has this paper been cited?

8 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at cIRcle (University of British Columbia): sign in and open the full text from this page.

Who wrote this paper?

Bobak Shahriari.

What is the DOI of this paper?

10.14288/1.0314167, permanently at https://doi.org/10.14288/1.0314167. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.