Conference paper · 2017 · Open access

Hyperband: Bandit-Based Configuration Evaluation for Hyperparameter Optimization

Lisha Li, Kevin Jamieson, Giulia DeSalvo, Afshin Rostamizadeh, Ameet Talwalkar

International Conference on Learning Representations · Published 24 April 2017

Open full textCite this paper

In brief

“Hyperband: Bandit-Based Configuration Evaluation for Hyperparameter Optimization” is a 2017 conference paper by Lisha Li and 4 co-authors, published in International Conference on Learning Representations. OpenAlex counts 187 citations as of 19 November 2026. It is open access: the full text is free to read at International Conference on Learning Representations.

Citations
187
Most cited in
2022 (32)
Field-weighted impact
5.35
Authors
5

Abstract

Performance of machine learning algorithms depends critically on identifying a good set of hyperparameters. While recent approaches use Bayesian Optimization to adaptively select configurations, we focus on speeding up random search through adaptive resource allocation. We present Hyperband, a novel algorithm for hyperparameter optimization that is simple, flexible, and theoretically sound. Hyperband is a principled early-stoppping method that adaptively allocates a predefined resource, e.g., iterations, data samples or number of features, to randomly sampled configurations. We compare Hyperband with state-of-the-art Bayesian Optimization methods on several hyperparameter optimization problems. We observe that Hyperband can provide over an order of magnitude speedups over competitors on a variety of neural network and kernel-based learning problems.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Li, L., Jamieson, K., DeSalvo, G., Rostamizadeh, A., & Talwalkar, A. (2017). Hyperband: Bandit-Based Configuration Evaluation for Hyperparameter Optimization. International Conference on Learning Representations. https://openreview.net/pdf?id=ry18Ww5ee

MLA 9

Li, Lisha, et al. “Hyperband: Bandit-Based Configuration Evaluation for Hyperparameter Optimization.” International Conference on Learning Representations, 2017. https://openreview.net/pdf?id=ry18Ww5ee.

Chicago

Li, Lisha, Kevin Jamieson, Giulia DeSalvo, Afshin Rostamizadeh, and Ameet Talwalkar. 2017. “Hyperband: Bandit-Based Configuration Evaluation for Hyperparameter Optimization.” International Conference on Learning Representations. https://openreview.net/pdf?id=ry18Ww5ee.

Harvard

Li, L. et al. (2017) ‘Hyperband: Bandit-Based Configuration Evaluation for Hyperparameter Optimization’, International Conference on Learning Representations. Available at: https://openreview.net/pdf?id=ry18Ww5ee.

IEEE

L. Li, K. Jamieson, G. DeSalvo, A. Rostamizadeh, and A. Talwalkar, “Hyperband: Bandit-Based Configuration Evaluation for Hyperparameter Optimization,” International Conference on Learning Representations, 2017.

BibTeX

@inproceedings{li2017hyperband,
  title     = {{Hyperband: Bandit-Based Configuration Evaluation for Hyperparameter Optimization}},
  author    = {Li, Lisha and Jamieson, Kevin and DeSalvo, Giulia and Rostamizadeh, Afshin and Talwalkar, Ameet},
  booktitle = {International Conference on Learning Representations},
  year      = {2017},
  url       = {https://openreview.net/pdf?id=ry18Ww5ee}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
201755
201899
20192323
20201717
20212424
20223232
20232020
20241919
20252121
20261616

Its field-weighted citation impact is 5.35: it has been cited 5.35 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification

  • hyperparameter optimization
  • Hyperband
  • early stopping
  • adaptive resource allocation
  • Bayesian optimization comparison
  • neural network hyperparameters
  • kernel methods

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Li, L., Jamieson, K., DeSalvo, G., Rostamizadeh, A., & Talwalkar, A. (2017). Hyperband: Bandit-Based Configuration Evaluation for Hyperparameter Optimization. International Conference on Learning Representations. https://openreview.net/pdf?id=ry18Ww5ee

How many times has this paper been cited?

187 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at International Conference on Learning Representations: sign in and open the full text from this page.

Who wrote this paper?

Lisha Li, Kevin Jamieson, Giulia DeSalvo, Afshin Rostamizadeh, Ameet Talwalkar.

Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.