Conference paper · 2017 · Open access
Hyperband: Bandit-Based Configuration Evaluation for Hyperparameter Optimization
International Conference on Learning Representations · Published 24 April 2017
In brief
“Hyperband: Bandit-Based Configuration Evaluation for Hyperparameter Optimization” is a 2017 conference paper by Lisha Li and 4 co-authors, published in International Conference on Learning Representations. OpenAlex counts 187 citations as of 19 November 2026. It is open access: the full text is free to read at International Conference on Learning Representations.
- Citations
- 187
- Most cited in
- 2022 (32)
- Field-weighted impact
- 5.35
- Authors
- 5
Abstract
Performance of machine learning algorithms depends critically on identifying a good set of hyperparameters. While recent approaches use Bayesian Optimization to adaptively select configurations, we focus on speeding up random search through adaptive resource allocation. We present Hyperband, a novel algorithm for hyperparameter optimization that is simple, flexible, and theoretically sound. Hyperband is a principled early-stoppping method that adaptively allocates a predefined resource, e.g., iterations, data samples or number of features, to randomly sampled configurations. We compare Hyperband with state-of-the-art Bayesian Optimization methods on several hyperparameter optimization problems. We observe that Hyperband can provide over an order of magnitude speedups over competitors on a variety of neural network and kernel-based learning problems.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Li, L., Jamieson, K., DeSalvo, G., Rostamizadeh, A., & Talwalkar, A. (2017). Hyperband: Bandit-Based Configuration Evaluation for Hyperparameter Optimization. International Conference on Learning Representations. https://openreview.net/pdf?id=ry18Ww5ee
MLA 9
Li, Lisha, et al. “Hyperband: Bandit-Based Configuration Evaluation for Hyperparameter Optimization.” International Conference on Learning Representations, 2017. https://openreview.net/pdf?id=ry18Ww5ee.
Chicago
Li, Lisha, Kevin Jamieson, Giulia DeSalvo, Afshin Rostamizadeh, and Ameet Talwalkar. 2017. “Hyperband: Bandit-Based Configuration Evaluation for Hyperparameter Optimization.” International Conference on Learning Representations. https://openreview.net/pdf?id=ry18Ww5ee.
Harvard
Li, L. et al. (2017) ‘Hyperband: Bandit-Based Configuration Evaluation for Hyperparameter Optimization’, International Conference on Learning Representations. Available at: https://openreview.net/pdf?id=ry18Ww5ee.
IEEE
L. Li, K. Jamieson, G. DeSalvo, A. Rostamizadeh, and A. Talwalkar, “Hyperband: Bandit-Based Configuration Evaluation for Hyperparameter Optimization,” International Conference on Learning Representations, 2017.
BibTeX
@inproceedings{li2017hyperband,
title = {{Hyperband: Bandit-Based Configuration Evaluation for Hyperparameter Optimization}},
author = {Li, Lisha and Jamieson, Kevin and DeSalvo, Giulia and Rostamizadeh, Afshin and Talwalkar, Ameet},
booktitle = {International Conference on Learning Representations},
year = {2017},
url = {https://openreview.net/pdf?id=ry18Ww5ee}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2017 | 5 | |
| 2018 | 9 | |
| 2019 | 23 | |
| 2020 | 17 | |
| 2021 | 24 | |
| 2022 | 32 | |
| 2023 | 20 | |
| 2024 | 19 | |
| 2025 | 21 | |
| 2026 | 16 |
Its field-weighted citation impact is 5.35: it has been cited 5.35 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- hyperparameter optimization
- Hyperband
- early stopping
- adaptive resource allocation
- Bayesian optimization comparison
- neural network hyperparameters
- kernel methods
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Li, L., Jamieson, K., DeSalvo, G., Rostamizadeh, A., & Talwalkar, A. (2017). Hyperband: Bandit-Based Configuration Evaluation for Hyperparameter Optimization. International Conference on Learning Representations. https://openreview.net/pdf?id=ry18Ww5ee
How many times has this paper been cited?
187 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at International Conference on Learning Representations: sign in and open the full text from this page.
Who wrote this paper?
Lisha Li, Kevin Jamieson, Giulia DeSalvo, Afshin Rostamizadeh, Ameet Talwalkar.
Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.