Journal article · 2019 · Open access
Hyperparameter Optimization for Machine Learning Models Based on Bayesian Optimization
Journal of Electronic Science and Technology, 17(1), 26–40 · Published 1 March 2019 · DOI 10.11989/jest.1674-862x.80904120
In brief
“Hyperparameter Optimization for Machine Learning Models Based on Bayesian Optimization” is a 2019 journal article by Jia Wu and 5 co-authors, published in Journal of Electronic Science and Technology. OpenAlex counts 2,445 citations as of 19 November 2026. It is open access under a CC BY-NC-ND licence: the full text is free to read at HAL.
- Citations
- 2,445
- Most cited in
- 2025 (620)
- Field-weighted impact
- 37.43
- Authors
- 6
Abstract
Hyperparameters are important for machine learning algorithms since they directly control the behaviors of training algorithms and have a significant effect on the performance of machine learning models. Several techniques have been developed and successfully applied for certain application domains. However, this work demands professional knowledge and expert experience. And sometimes it has to resort to the brute-force search. Therefore, if an efficient hyperparameter optimization algorithm can be developed to optimize any given machine learning method, it will greatly improve the efficiency of machine learning. In this paper, we consider building the relationship between the performance of the machine learning models and their hyperparameters by Gaussian processes. In this way, the hyperparameter tuning problem can be abstracted as an optimization problem and Bayesian optimization is used to solve the problem. Bayesian optimization is based on the Bayesian theorem. It sets a prior over the optimization function and gathers the information from the previous sample to update the posterior of the optimization function. A utility function selects the next sample point to maximize the optimization function. Several experiments were conducted on standard test datasets. Experiment results show that the proposed method can find the best hyperparameters for the widely used machine learning models, such as the random forest algorithm and the neural networks, even multi-grained cascade forest under the consideration of time cost.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Wu, J., Chen, X. Y., Zhang, H., XIONG, L., Lei, H., & Deng, S. (2019). Hyperparameter Optimization for Machine Learning Models Based on Bayesian Optimization. Journal of Electronic Science and Technology, 17(1), 26–40. https://doi.org/10.11989/jest.1674-862x.80904120
MLA 9
Wu, Jia, et al. “Hyperparameter Optimization for Machine Learning Models Based on Bayesian Optimization.” Journal of Electronic Science and Technology, vol. 17, no. 1, 2019, pp. 26–40. https://doi.org/10.11989/jest.1674-862x.80904120.
Chicago
Wu, Jia, Xiu Yun Chen, Hao Zhang, Lidong XIONG, Hang Lei, and Sihao Deng. 2019. “Hyperparameter Optimization for Machine Learning Models Based on Bayesian Optimization.” Journal of Electronic Science and Technology 17 (1): 26–40. https://doi.org/10.11989/jest.1674-862x.80904120.
Harvard
Wu, J. et al. (2019) ‘Hyperparameter Optimization for Machine Learning Models Based on Bayesian Optimization’, Journal of Electronic Science and Technology, 17(1), pp. 26–40. doi:10.11989/jest.1674-862x.80904120.
IEEE
J. Wu, X. Y. Chen, H. Zhang, L. XIONG, H. Lei, and S. Deng, “Hyperparameter Optimization for Machine Learning Models Based on Bayesian Optimization,” Journal of Electronic Science and Technology, vol. 17, no. 1, pp. 26–40, 2019, doi: 10.11989/jest.1674-862x.80904120.
BibTeX
@article{wu2019hyperparameter,
title = {{Hyperparameter Optimization for Machine Learning Models Based on Bayesian Optimization}},
author = {Wu, Jia and Chen, Xiu Yun and Zhang, Hao and XIONG, Lidong and Lei, Hang and Deng, Sihao},
journal = {Journal of Electronic Science and Technology},
year = {2019},
volume = {17},
number = {1},
pages = {26--40},
doi = {10.11989/jest.1674-862x.80904120},
url = {https://doi.org/10.11989/jest.1674-862x.80904120}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2019 | 1 | |
| 2020 | 28 | |
| 2021 | 161 | |
| 2022 | 263 | |
| 2023 | 381 | |
| 2024 | 576 | |
| 2025 | 620 | |
| 2026 | 415 |
Its field-weighted citation impact is 37.43: it has been cited 37.43 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- hyperparameter optimization
- Bayesian optimization
- Gaussian processes
- utility functions
- random forest
- artificial neural networks
- time costs
- surrogate models
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Wu, J., Chen, X. Y., Zhang, H., XIONG, L., Lei, H., & Deng, S. (2019). Hyperparameter Optimization for Machine Learning Models Based on Bayesian Optimization. Journal of Electronic Science and Technology, 17(1), 26–40. https://doi.org/10.11989/jest.1674-862x.80904120
How many times has this paper been cited?
2,445 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at HAL: sign in and open the full text from this page.
Who wrote this paper?
Jia Wu, Xiu Yun Chen, Hao Zhang, Lidong XIONG, Hang Lei, Sihao Deng.
What is the DOI of this paper?
10.11989/jest.1674-862x.80904120, permanently at https://doi.org/10.11989/jest.1674-862x.80904120. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.