Preprint · 2018 · Open access

Scalable Meta-Learning for Bayesian Optimization

Matthias Feurer, Benjamin Letham, Eytan Bakshy

arXiv (Cornell University) · Published 6 February 2018

Open full textCite this paper

In brief

“Scalable Meta-Learning for Bayesian Optimization” is a 2018 preprint by Matthias Feurer and 2 co-authors, published in arXiv (Cornell University). OpenAlex counts 51 citations as of 19 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).

Citations
51
Most cited in
2021 (10)
References
57
Authors
3

Abstract

Bayesian optimization has become a standard technique for hyperparameter optimization, including data-intensive models such as deep neural networks that may take days or weeks to train. We consider the setting where previous optimization runs are available, and we wish to use their results to warm-start a new optimization run. We develop an ensemble model that can incorporate the results of past optimization runs, while avoiding the poor scaling that comes with putting all results into a single Gaussian process model. The ensemble combines models from past runs according to estimates of their generalization performance on the current optimization. Results from a large collection of hyperparameter optimization benchmark problems and from optimization of a production computer vision platform at Facebook show that the ensemble can substantially reduce the time it takes to obtain near-optimal configurations, and is useful for warm-starting expensive searches or running quick re-optimizations.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Feurer, M., Letham, B., & Bakshy, E. (2018). Scalable Meta-Learning for Bayesian Optimization. arXiv (Cornell University). https://arxiv.org/pdf/1802.02219

MLA 9

Feurer, Matthias, et al. “Scalable Meta-Learning for Bayesian Optimization.” arXiv (Cornell University), 2018. https://arxiv.org/pdf/1802.02219.

Chicago

Feurer, Matthias, Benjamin Letham, and Eytan Bakshy. 2018. “Scalable Meta-Learning for Bayesian Optimization.” arXiv (Cornell University). https://arxiv.org/pdf/1802.02219.

Harvard

Feurer, M., Letham, B. and Bakshy, E. (2018) ‘Scalable Meta-Learning for Bayesian Optimization’, arXiv (Cornell University). Available at: https://arxiv.org/pdf/1802.02219.

IEEE

M. Feurer, B. Letham, and E. Bakshy, “Scalable Meta-Learning for Bayesian Optimization,” arXiv (Cornell University), 2018.

BibTeX

@misc{feurer2018scalable,
  title     = {{Scalable Meta-Learning for Bayesian Optimization}},
  author    = {Feurer, Matthias and Letham, Benjamin and Bakshy, Eytan},
  howpublished = {arXiv (Cornell University)},
  year      = {2018},
  url       = {https://arxiv.org/pdf/1802.02219}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
201844
201988
202044
20211010
202255
202344
202466
202566
202644

Topic and keywords

Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research

  • Bayesian optimization
  • meta-learning
  • hyperparameter optimization
  • ensemble learning
  • warm start
  • Gaussian processes
  • scalability
  • deep neural network

Work with this paper

Most-cited papers in Decision Sciences

All highly cited Decision Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Feurer, M., Letham, B., & Bakshy, E. (2018). Scalable Meta-Learning for Bayesian Optimization. arXiv (Cornell University). https://arxiv.org/pdf/1802.02219

How many times has this paper been cited?

51 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the full text from this page.

Who wrote this paper?

Matthias Feurer, Benjamin Letham, Eytan Bakshy.

Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.