Preprint · 2019 · Open access
Tuning Hyperparameters without Grad Students: Scalable and Robust Bayesian Optimisation with Dragonfly
arXiv (Cornell University), 21(81), 1–27 · Published 15 March 2019 · DOI 10.48550/arxiv.1903.06694
In brief
“Tuning Hyperparameters without Grad Students: Scalable and Robust Bayesian Optimisation with Dragonfly” is a 2019 preprint by Kirthevasan Kandasamy and 7 co-authors, published in arXiv (Cornell University). OpenAlex counts 251 citations as of 19 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).
- Citations
- 251
- Most cited in
- 2021 (63)
- References
- 82
- Authors
- 8
Abstract
Bayesian Optimisation (BO) refers to a suite of techniques for global optimisation of expensive black box functions, which use introspective Bayesian models of the function to efficiently search for the optimum. While BO has been applied successfully in many applications, modern optimisation tasks usher in new challenges where conventional methods fail spectacularly. In this work, we present Dragonfly, an open source Python library for scalable and robust BO. Dragonfly incorporates multiple recently developed methods that allow BO to be applied in challenging real world settings; these include better methods for handling higher dimensional domains, methods for handling multi-fidelity evaluations when cheap approximations of an expensive function are available, methods for optimising over structured combinatorial spaces, such as the space of neural network architectures, and methods for handling parallel evaluations. Additionally, we develop new methodological improvements in BO for selecting the Bayesian model, selecting the acquisition function, and optimising over complex domains with different variable types and additional constraints. We compare Dragonfly to a suite of other packages and algorithms for global optimisation and demonstrate that when the above methods are integrated, they enable significant improvements in the performance of BO. The Dragonfly library is available at dragonfly.github.io.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Kandasamy, K., Vysyaraju, K. R., Neiswanger, W., Paria, B., Collins, C. R., Schneider, J., Póczos, B., & Xing, E. P. (2019). Tuning Hyperparameters without Grad Students: Scalable and Robust Bayesian Optimisation with Dragonfly. arXiv (Cornell University), 21(81), 1–27. https://doi.org/10.48550/arxiv.1903.06694
MLA 9
Kandasamy, Kirthevasan, et al. “Tuning Hyperparameters without Grad Students: Scalable and Robust Bayesian Optimisation with Dragonfly.” arXiv (Cornell University), vol. 21, no. 81, 2019, pp. 1–27. https://doi.org/10.48550/arxiv.1903.06694.
Chicago
Kandasamy, Kirthevasan, Karun Raju Vysyaraju, Willie Neiswanger, Biswajit Paria, Christopher R. Collins, Jeff Schneider, Barnabás Póczos, and Eric P. Xing. 2019. “Tuning Hyperparameters without Grad Students: Scalable and Robust Bayesian Optimisation with Dragonfly.” arXiv (Cornell University) 21 (81): 1–27. https://doi.org/10.48550/arxiv.1903.06694.
Harvard
Kandasamy, K. et al. (2019) ‘Tuning Hyperparameters without Grad Students: Scalable and Robust Bayesian Optimisation with Dragonfly’, arXiv (Cornell University), 21(81), pp. 1–27. doi:10.48550/arxiv.1903.06694.
IEEE
K. Kandasamy et al., “Tuning Hyperparameters without Grad Students: Scalable and Robust Bayesian Optimisation with Dragonfly,” arXiv (Cornell University), vol. 21, no. 81, pp. 1–27, 2019, doi: 10.48550/arxiv.1903.06694.
BibTeX
@misc{kandasamy2019tuning,
title = {{Tuning Hyperparameters without Grad Students: Scalable and Robust Bayesian Optimisation with Dragonfly}},
author = {Kandasamy, Kirthevasan and Vysyaraju, Karun Raju and Neiswanger, Willie and Paria, Biswajit and Collins, Christopher R. and Schneider, Jeff and Póczos, Barnabás and Xing, Eric P.},
howpublished = {arXiv (Cornell University)},
year = {2019},
volume = {21},
number = {81},
pages = {1--27},
doi = {10.48550/arxiv.1903.06694},
url = {https://doi.org/10.48550/arxiv.1903.06694}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2018 | 2 | |
| 2019 | 10 | |
| 2020 | 20 | |
| 2021 | 63 | |
| 2022 | 35 | |
| 2023 | 44 | |
| 2024 | 25 | |
| 2025 | 34 | |
| 2026 | 18 |
Topic and keywords
Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
- Bayesian optimization
- hyperparameter optimization
- high-dimensional optimization
- combinatorial optimization
- neural architecture search
- parallel evaluation
- Bayesian model selection
- constrained optimization
Work with this paper
Most-cited papers in Decision Sciences
- The PRISMA 2020 statement: an updated guideline for reporting systematic reviewsMatthew James Page, Joanne E. McKenzie, Patrick M. Bossuyt and 23 more · BMJ · 2021 · 144,919 citations
- Evaluating Structural Equation Models with Unobservable Variables and Measurement ErrorClaes Fornell, David F. Larcker · Journal of Marketing Research · 1981 · 118,336 citations
- Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternativesLi‐tze Hu, Peter M. Bentler · Structural Equation Modeling A Multidisciplinary Journal · 1999 · 117,461 citations
- Common method biases in behavioral research: A critical review of the literature and recommended remedies.Philip M. Podsakoff, SCOTT B. MACKENZIE, Jeong Yeon Lee and 1 more · Journal of Applied Psychology · 2003 · 89,248 citations
- Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statementDavid Moher, Alessandro Liberati, Jennifer Tetzlaff and 2 more · BMJ · 2009 · 85,524 citations
Questions about this paper
How do I cite this paper in APA style?
Kandasamy, K., Vysyaraju, K. R., Neiswanger, W., Paria, B., Collins, C. R., Schneider, J., Póczos, B., & Xing, E. P. (2019). Tuning Hyperparameters without Grad Students: Scalable and Robust Bayesian Optimisation with Dragonfly. arXiv (Cornell University), 21(81), 1–27. https://doi.org/10.48550/arxiv.1903.06694
How many times has this paper been cited?
251 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.
Who wrote this paper?
Kirthevasan Kandasamy, Karun Raju Vysyaraju, Willie Neiswanger, Biswajit Paria, Christopher R. Collins, Jeff Schneider, Barnabás Póczos, Eric P. Xing.
What is the DOI of this paper?
10.48550/arxiv.1903.06694, permanently at https://doi.org/10.48550/arxiv.1903.06694. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.