Journal article · 2019 · Open access

Hyperparameter Optimization for Machine Learning Models Based on Bayesian Optimization

Jia Wu, Xiu Yun Chen, Hao Zhang, Lidong XIONG, Hang Lei, Sihao Deng

Journal of Electronic Science and Technology, 17(1), 26–40 · Published 1 March 2019 · DOI 10.11989/jest.1674-862x.80904120

Open full textView at the publisherCite this paper

In brief

“Hyperparameter Optimization for Machine Learning Models Based on Bayesian Optimization” is a 2019 journal article by Jia Wu and 5 co-authors, published in Journal of Electronic Science and Technology. OpenAlex counts 2,445 citations as of 19 November 2026. It is open access under a CC BY-NC-ND licence: the full text is free to read at HAL.

Citations
2,445
Most cited in
2025 (620)
Field-weighted impact
37.43
Authors
6

Abstract

Hyperparameters are important for machine learning algorithms since they directly control the behaviors of training algorithms and have a significant effect on the performance of machine learning models. Several techniques have been developed and successfully applied for certain application domains. However, this work demands professional knowledge and expert experience. And sometimes it has to resort to the brute-force search. Therefore, if an efficient hyperparameter optimization algorithm can be developed to optimize any given machine learning method, it will greatly improve the efficiency of machine learning. In this paper, we consider building the relationship between the performance of the machine learning models and their hyperparameters by Gaussian processes. In this way, the hyperparameter tuning problem can be abstracted as an optimization problem and Bayesian optimization is used to solve the problem. Bayesian optimization is based on the Bayesian theorem. It sets a prior over the optimization function and gathers the information from the previous sample to update the posterior of the optimization function. A utility function selects the next sample point to maximize the optimization function. Several experiments were conducted on standard test datasets. Experiment results show that the proposed method can find the best hyperparameters for the widely used machine learning models, such as the random forest algorithm and the neural networks, even multi-grained cascade forest under the consideration of time cost.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Wu, J., Chen, X. Y., Zhang, H., XIONG, L., Lei, H., & Deng, S. (2019). Hyperparameter Optimization for Machine Learning Models Based on Bayesian Optimization. Journal of Electronic Science and Technology, 17(1), 26–40. https://doi.org/10.11989/jest.1674-862x.80904120

MLA 9

Wu, Jia, et al. “Hyperparameter Optimization for Machine Learning Models Based on Bayesian Optimization.” Journal of Electronic Science and Technology, vol. 17, no. 1, 2019, pp. 26–40. https://doi.org/10.11989/jest.1674-862x.80904120.

Chicago

Wu, Jia, Xiu Yun Chen, Hao Zhang, Lidong XIONG, Hang Lei, and Sihao Deng. 2019. “Hyperparameter Optimization for Machine Learning Models Based on Bayesian Optimization.” Journal of Electronic Science and Technology 17 (1): 26–40. https://doi.org/10.11989/jest.1674-862x.80904120.

Harvard

Wu, J. et al. (2019) ‘Hyperparameter Optimization for Machine Learning Models Based on Bayesian Optimization’, Journal of Electronic Science and Technology, 17(1), pp. 26–40. doi:10.11989/jest.1674-862x.80904120.

IEEE

J. Wu, X. Y. Chen, H. Zhang, L. XIONG, H. Lei, and S. Deng, “Hyperparameter Optimization for Machine Learning Models Based on Bayesian Optimization,” Journal of Electronic Science and Technology, vol. 17, no. 1, pp. 26–40, 2019, doi: 10.11989/jest.1674-862x.80904120.

BibTeX

@article{wu2019hyperparameter,
  title     = {{Hyperparameter Optimization for Machine Learning Models Based on Bayesian Optimization}},
  author    = {Wu, Jia and Chen, Xiu Yun and Zhang, Hao and XIONG, Lidong and Lei, Hang and Deng, Sihao},
  journal   = {Journal of Electronic Science and Technology},
  year      = {2019},
  volume    = {17},
  number    = {1},
  pages     = {26--40},
  doi       = {10.11989/jest.1674-862x.80904120},
  url       = {https://doi.org/10.11989/jest.1674-862x.80904120}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
201911
20202828
2021161161
2022263263
2023381381
2024576576
2025620620
2026415415

Its field-weighted citation impact is 37.43: it has been cited 37.43 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification

  • hyperparameter optimization
  • Bayesian optimization
  • Gaussian processes
  • utility functions
  • random forest
  • artificial neural networks
  • time costs
  • surrogate models

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Wu, J., Chen, X. Y., Zhang, H., XIONG, L., Lei, H., & Deng, S. (2019). Hyperparameter Optimization for Machine Learning Models Based on Bayesian Optimization. Journal of Electronic Science and Technology, 17(1), 26–40. https://doi.org/10.11989/jest.1674-862x.80904120

How many times has this paper been cited?

2,445 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at HAL: sign in and open the full text from this page.

Who wrote this paper?

Jia Wu, Xiu Yun Chen, Hao Zhang, Lidong XIONG, Hang Lei, Sihao Deng.

What is the DOI of this paper?

10.11989/jest.1674-862x.80904120, permanently at https://doi.org/10.11989/jest.1674-862x.80904120. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.