Journal article · 2023 · Open access
Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges
Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery, 13(2) · Published 16 January 2023 · DOI 10.1002/widm.1484
In brief
“Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges” is a 2023 journal article by Bernd Bischl and 11 co-authors, published in Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery. OpenAlex counts 1,574 citations as of 19 November 2026. It is open access under a CC BY licence: the full text is free to read at Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery.
- Citations
- 1,574
- Most cited in
- 2026 (599)
- Field-weighted impact
- 88.56
- References
- 274
- Authors
- 12
Abstract
Most machine learning algorithms are configured by a set of hyperparameters whose values must be carefully chosen and which often considerably impact performance. To avoid a time‐consuming and irreproducible manual process of trial‐and‐error to find well‐performing hyperparameter configurations, various automatic hyperparameter optimization (HPO) methods—for example, based on resampling error estimation for supervised machine learning—can be employed. After introducing HPO from a general perspective, this paper reviews important HPO methods, from simple techniques such as grid or random search to more advanced methods like evolution strategies, Bayesian optimization, Hyperband, and racing. This work gives practical recommendations regarding important choices to be made when conducting HPO, including the HPO algorithms themselves, performance evaluation, how to combine HPO with machine learning pipelines, runtime improvements, and parallelization. This article is categorized under: Algorithmic Development > Statistics Technologies > Machine Learning Technologies > Prediction
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Bischl, B., Binder, M., Lang, M., Pielok, T., Richter, J., Coors, S., Thomas, J., Ullmann, T., Becker, M., Boulesteix, A., Deng, D., & Lindauer, M. (2023). Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges. Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery, 13(2). https://doi.org/10.1002/widm.1484
MLA 9
Bischl, Bernd, et al. “Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges.” Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery, vol. 13, no. 2, 2023. https://doi.org/10.1002/widm.1484.
Chicago
Bischl, Bernd, Martin Binder, Michel Lang, Tobias Pielok, Jakob Richter, Stefan Coors, Janek Thomas, et al. 2023. “Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges.” Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery 13 (2). https://doi.org/10.1002/widm.1484.
Harvard
Bischl, B. et al. (2023) ‘Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges’, Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery, 13(2). doi:10.1002/widm.1484.
IEEE
B. Bischl et al., “Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges,” Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery, vol. 13, no. 2, 2023, doi: 10.1002/widm.1484.
BibTeX
@article{bischl2023hyperparameter,
title = {{Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges}},
author = {Bischl, Bernd and Binder, Martin and Lang, Michel and Pielok, Tobias and Richter, Jakob and Coors, Stefan and Thomas, Janek and Ullmann, Theresa and Becker, Marc and Boulesteix, Anne‐Laure and Deng, Difan and Lindauer, Marius},
journal = {Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery},
year = {2023},
volume = {13},
number = {2},
doi = {10.1002/widm.1484},
url = {https://doi.org/10.1002/widm.1484}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2020 | 1 | |
| 2021 | 4 | |
| 2022 | 31 | |
| 2023 | 107 | |
| 2024 | 307 | |
| 2025 | 525 | |
| 2026 | 599 |
Its field-weighted citation impact is 88.56: it has been cited 88.56 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- hyperparameter optimization
- automatic hyperparameter tuning
- grid search
- random search
- Bayesian optimization
- evolution strategies
- Hyperband
- racing
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Bischl, B., Binder, M., Lang, M., Pielok, T., Richter, J., Coors, S., Thomas, J., Ullmann, T., Becker, M., Boulesteix, A., Deng, D., & Lindauer, M. (2023). Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges. Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery, 13(2). https://doi.org/10.1002/widm.1484
How many times has this paper been cited?
1,574 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery: sign in and open the PDF from this page.
Who wrote this paper?
Bernd Bischl, Martin Binder, Michel Lang, Tobias Pielok, Jakob Richter, Stefan Coors, Janek Thomas, Theresa Ullmann, Marc Becker, Anne‐Laure Boulesteix, Difan Deng, Marius Lindauer.
What is the DOI of this paper?
10.1002/widm.1484, permanently at https://doi.org/10.1002/widm.1484. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.