Preprint · 2018 · Open access
Scalable Meta-Learning for Bayesian Optimization
arXiv (Cornell University) · Published 6 February 2018
In brief
“Scalable Meta-Learning for Bayesian Optimization” is a 2018 preprint by Matthias Feurer and 2 co-authors, published in arXiv (Cornell University). OpenAlex counts 51 citations as of 19 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).
- Citations
- 51
- Most cited in
- 2021 (10)
- References
- 57
- Authors
- 3
Abstract
Bayesian optimization has become a standard technique for hyperparameter optimization, including data-intensive models such as deep neural networks that may take days or weeks to train. We consider the setting where previous optimization runs are available, and we wish to use their results to warm-start a new optimization run. We develop an ensemble model that can incorporate the results of past optimization runs, while avoiding the poor scaling that comes with putting all results into a single Gaussian process model. The ensemble combines models from past runs according to estimates of their generalization performance on the current optimization. Results from a large collection of hyperparameter optimization benchmark problems and from optimization of a production computer vision platform at Facebook show that the ensemble can substantially reduce the time it takes to obtain near-optimal configurations, and is useful for warm-starting expensive searches or running quick re-optimizations.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Feurer, M., Letham, B., & Bakshy, E. (2018). Scalable Meta-Learning for Bayesian Optimization. arXiv (Cornell University). https://arxiv.org/pdf/1802.02219
MLA 9
Feurer, Matthias, et al. “Scalable Meta-Learning for Bayesian Optimization.” arXiv (Cornell University), 2018. https://arxiv.org/pdf/1802.02219.
Chicago
Feurer, Matthias, Benjamin Letham, and Eytan Bakshy. 2018. “Scalable Meta-Learning for Bayesian Optimization.” arXiv (Cornell University). https://arxiv.org/pdf/1802.02219.
Harvard
Feurer, M., Letham, B. and Bakshy, E. (2018) ‘Scalable Meta-Learning for Bayesian Optimization’, arXiv (Cornell University). Available at: https://arxiv.org/pdf/1802.02219.
IEEE
M. Feurer, B. Letham, and E. Bakshy, “Scalable Meta-Learning for Bayesian Optimization,” arXiv (Cornell University), 2018.
BibTeX
@misc{feurer2018scalable,
title = {{Scalable Meta-Learning for Bayesian Optimization}},
author = {Feurer, Matthias and Letham, Benjamin and Bakshy, Eytan},
howpublished = {arXiv (Cornell University)},
year = {2018},
url = {https://arxiv.org/pdf/1802.02219}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2018 | 4 | |
| 2019 | 8 | |
| 2020 | 4 | |
| 2021 | 10 | |
| 2022 | 5 | |
| 2023 | 4 | |
| 2024 | 6 | |
| 2025 | 6 | |
| 2026 | 4 |
Topic and keywords
Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
- Bayesian optimization
- meta-learning
- hyperparameter optimization
- ensemble learning
- warm start
- Gaussian processes
- scalability
- deep neural network
Work with this paper
Most-cited papers in Decision Sciences
- The PRISMA 2020 statement: an updated guideline for reporting systematic reviewsMatthew James Page, Joanne E. McKenzie, Patrick M. Bossuyt and 23 more · BMJ · 2021 · 144,919 citations
- Evaluating Structural Equation Models with Unobservable Variables and Measurement ErrorClaes Fornell, David F. Larcker · Journal of Marketing Research · 1981 · 118,336 citations
- Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternativesLi‐tze Hu, Peter M. Bentler · Structural Equation Modeling A Multidisciplinary Journal · 1999 · 117,461 citations
- Common method biases in behavioral research: A critical review of the literature and recommended remedies.Philip M. Podsakoff, SCOTT B. MACKENZIE, Jeong Yeon Lee and 1 more · Journal of Applied Psychology · 2003 · 89,248 citations
- Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statementDavid Moher, Alessandro Liberati, Jennifer Tetzlaff and 2 more · BMJ · 2009 · 85,524 citations
Questions about this paper
How do I cite this paper in APA style?
Feurer, M., Letham, B., & Bakshy, E. (2018). Scalable Meta-Learning for Bayesian Optimization. arXiv (Cornell University). https://arxiv.org/pdf/1802.02219
How many times has this paper been cited?
51 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at arXiv (Cornell University): sign in and open the full text from this page.
Who wrote this paper?
Matthias Feurer, Benjamin Letham, Eytan Bakshy.
Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.