Journal article · 2023 · Open access

Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges

Bernd Bischl, Martin Binder, Michel Lang, Tobias Pielok, Jakob Richter, Stefan Coors, Janek Thomas, Theresa Ullmann, Marc Becker, Anne‐Laure Boulesteix, Difan Deng, Marius Lindauer

Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery, 13(2) · Published 16 January 2023 · DOI 10.1002/widm.1484

Open PDFView at the publisherCite this paper

In brief

“Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges” is a 2023 journal article by Bernd Bischl and 11 co-authors, published in Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery. OpenAlex counts 1,574 citations as of 19 November 2026. It is open access under a CC BY licence: the full text is free to read at Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery.

Citations
1,574
Most cited in
2026 (599)
Field-weighted impact
88.56
References
274
Authors
12

Abstract

Most machine learning algorithms are configured by a set of hyperparameters whose values must be carefully chosen and which often considerably impact performance. To avoid a time‐consuming and irreproducible manual process of trial‐and‐error to find well‐performing hyperparameter configurations, various automatic hyperparameter optimization (HPO) methods—for example, based on resampling error estimation for supervised machine learning—can be employed. After introducing HPO from a general perspective, this paper reviews important HPO methods, from simple techniques such as grid or random search to more advanced methods like evolution strategies, Bayesian optimization, Hyperband, and racing. This work gives practical recommendations regarding important choices to be made when conducting HPO, including the HPO algorithms themselves, performance evaluation, how to combine HPO with machine learning pipelines, runtime improvements, and parallelization. This article is categorized under: Algorithmic Development > Statistics Technologies > Machine Learning Technologies > Prediction

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Bischl, B., Binder, M., Lang, M., Pielok, T., Richter, J., Coors, S., Thomas, J., Ullmann, T., Becker, M., Boulesteix, A., Deng, D., & Lindauer, M. (2023). Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges. Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery, 13(2). https://doi.org/10.1002/widm.1484

MLA 9

Bischl, Bernd, et al. “Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges.” Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery, vol. 13, no. 2, 2023. https://doi.org/10.1002/widm.1484.

Chicago

Bischl, Bernd, Martin Binder, Michel Lang, Tobias Pielok, Jakob Richter, Stefan Coors, Janek Thomas, et al. 2023. “Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges.” Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery 13 (2). https://doi.org/10.1002/widm.1484.

Harvard

Bischl, B. et al. (2023) ‘Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges’, Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery, 13(2). doi:10.1002/widm.1484.

IEEE

B. Bischl et al., “Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges,” Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery, vol. 13, no. 2, 2023, doi: 10.1002/widm.1484.

BibTeX

@article{bischl2023hyperparameter,
  title     = {{Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges}},
  author    = {Bischl, Bernd and Binder, Martin and Lang, Michel and Pielok, Tobias and Richter, Jakob and Coors, Stefan and Thomas, Janek and Ullmann, Theresa and Becker, Marc and Boulesteix, Anne‐Laure and Deng, Difan and Lindauer, Marius},
  journal   = {Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery},
  year      = {2023},
  volume    = {13},
  number    = {2},
  doi       = {10.1002/widm.1484},
  url       = {https://doi.org/10.1002/widm.1484}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202011
202144
20223131
2023107107
2024307307
2025525525
2026599599

Its field-weighted citation impact is 88.56: it has been cited 88.56 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification

  • hyperparameter optimization
  • automatic hyperparameter tuning
  • grid search
  • random search
  • Bayesian optimization
  • evolution strategies
  • Hyperband
  • racing

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Bischl, B., Binder, M., Lang, M., Pielok, T., Richter, J., Coors, S., Thomas, J., Ullmann, T., Becker, M., Boulesteix, A., Deng, D., & Lindauer, M. (2023). Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges. Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery, 13(2). https://doi.org/10.1002/widm.1484

How many times has this paper been cited?

1,574 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery: sign in and open the PDF from this page.

Who wrote this paper?

Bernd Bischl, Martin Binder, Michel Lang, Tobias Pielok, Jakob Richter, Stefan Coors, Janek Thomas, Theresa Ullmann, Marc Becker, Anne‐Laure Boulesteix, Difan Deng, Marius Lindauer.

What is the DOI of this paper?

10.1002/widm.1484, permanently at https://doi.org/10.1002/widm.1484. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.