Preprint · 2019 · Open access

Tuning Hyperparameters without Grad Students: Scalable and Robust Bayesian Optimisation with Dragonfly

Kirthevasan Kandasamy, Karun Raju Vysyaraju, Willie Neiswanger, Biswajit Paria, Christopher R. Collins, Jeff Schneider, Barnabás Póczos, Eric P. Xing

arXiv (Cornell University), 21(81), 1–27 · Published 15 March 2019 · DOI 10.48550/arxiv.1903.06694

Open PDFView at the publisherCite this paper

In brief

“Tuning Hyperparameters without Grad Students: Scalable and Robust Bayesian Optimisation with Dragonfly” is a 2019 preprint by Kirthevasan Kandasamy and 7 co-authors, published in arXiv (Cornell University). OpenAlex counts 251 citations as of 19 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).

Citations
251
Most cited in
2021 (63)
References
82
Authors
8

Abstract

Bayesian Optimisation (BO) refers to a suite of techniques for global optimisation of expensive black box functions, which use introspective Bayesian models of the function to efficiently search for the optimum. While BO has been applied successfully in many applications, modern optimisation tasks usher in new challenges where conventional methods fail spectacularly. In this work, we present Dragonfly, an open source Python library for scalable and robust BO. Dragonfly incorporates multiple recently developed methods that allow BO to be applied in challenging real world settings; these include better methods for handling higher dimensional domains, methods for handling multi-fidelity evaluations when cheap approximations of an expensive function are available, methods for optimising over structured combinatorial spaces, such as the space of neural network architectures, and methods for handling parallel evaluations. Additionally, we develop new methodological improvements in BO for selecting the Bayesian model, selecting the acquisition function, and optimising over complex domains with different variable types and additional constraints. We compare Dragonfly to a suite of other packages and algorithms for global optimisation and demonstrate that when the above methods are integrated, they enable significant improvements in the performance of BO. The Dragonfly library is available at dragonfly.github.io.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Kandasamy, K., Vysyaraju, K. R., Neiswanger, W., Paria, B., Collins, C. R., Schneider, J., Póczos, B., & Xing, E. P. (2019). Tuning Hyperparameters without Grad Students: Scalable and Robust Bayesian Optimisation with Dragonfly. arXiv (Cornell University), 21(81), 1–27. https://doi.org/10.48550/arxiv.1903.06694

MLA 9

Kandasamy, Kirthevasan, et al. “Tuning Hyperparameters without Grad Students: Scalable and Robust Bayesian Optimisation with Dragonfly.” arXiv (Cornell University), vol. 21, no. 81, 2019, pp. 1–27. https://doi.org/10.48550/arxiv.1903.06694.

Chicago

Kandasamy, Kirthevasan, Karun Raju Vysyaraju, Willie Neiswanger, Biswajit Paria, Christopher R. Collins, Jeff Schneider, Barnabás Póczos, and Eric P. Xing. 2019. “Tuning Hyperparameters without Grad Students: Scalable and Robust Bayesian Optimisation with Dragonfly.” arXiv (Cornell University) 21 (81): 1–27. https://doi.org/10.48550/arxiv.1903.06694.

Harvard

Kandasamy, K. et al. (2019) ‘Tuning Hyperparameters without Grad Students: Scalable and Robust Bayesian Optimisation with Dragonfly’, arXiv (Cornell University), 21(81), pp. 1–27. doi:10.48550/arxiv.1903.06694.

IEEE

K. Kandasamy et al., “Tuning Hyperparameters without Grad Students: Scalable and Robust Bayesian Optimisation with Dragonfly,” arXiv (Cornell University), vol. 21, no. 81, pp. 1–27, 2019, doi: 10.48550/arxiv.1903.06694.

BibTeX

@misc{kandasamy2019tuning,
  title     = {{Tuning Hyperparameters without Grad Students: Scalable and Robust Bayesian Optimisation with Dragonfly}},
  author    = {Kandasamy, Kirthevasan and Vysyaraju, Karun Raju and Neiswanger, Willie and Paria, Biswajit and Collins, Christopher R. and Schneider, Jeff and Póczos, Barnabás and Xing, Eric P.},
  howpublished = {arXiv (Cornell University)},
  year      = {2019},
  volume    = {21},
  number    = {81},
  pages     = {1--27},
  doi       = {10.48550/arxiv.1903.06694},
  url       = {https://doi.org/10.48550/arxiv.1903.06694}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
201822
20191010
20202020
20216363
20223535
20234444
20242525
20253434
20261818

Topic and keywords

Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research

  • Bayesian optimization
  • hyperparameter optimization
  • high-dimensional optimization
  • combinatorial optimization
  • neural architecture search
  • parallel evaluation
  • Bayesian model selection
  • constrained optimization

Work with this paper

Most-cited papers in Decision Sciences

All highly cited Decision Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Kandasamy, K., Vysyaraju, K. R., Neiswanger, W., Paria, B., Collins, C. R., Schneider, J., Póczos, B., & Xing, E. P. (2019). Tuning Hyperparameters without Grad Students: Scalable and Robust Bayesian Optimisation with Dragonfly. arXiv (Cornell University), 21(81), 1–27. https://doi.org/10.48550/arxiv.1903.06694

How many times has this paper been cited?

251 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

Kirthevasan Kandasamy, Karun Raju Vysyaraju, Willie Neiswanger, Biswajit Paria, Christopher R. Collins, Jeff Schneider, Barnabás Póczos, Eric P. Xing.

What is the DOI of this paper?

10.48550/arxiv.1903.06694, permanently at https://doi.org/10.48550/arxiv.1903.06694. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.