Conference paper · 2022 · Open access
Transfer Learning based Search Space Design for Hyperparameter Tuning
ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), 967–977 · Published 12 August 2022 · DOI 10.1145/3534678.3539369
In brief
“Transfer Learning based Search Space Design for Hyperparameter Tuning” is a 2022 conference paper by Yang Li and 6 co-authors, published in ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD). OpenAlex counts 25 citations as of 19 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).
- Citations
- 25
- Most cited in
- 2023 (7)
- Field-weighted impact
- 1.29
- References
- 59
- Authors
- 7
Abstract
The tuning of hyperparameters becomes increasingly important as machine learning (ML) models have been extensively applied in data mining applications. Among various approaches, Bayesian optimization (BO) is a successful methodology to tune hyperparameters automatically. While traditional methods optimize each tuning task in isolation, there has been recent interest in speeding up BO by transferring knowledge across previous tasks. In this work, we introduce an automatic method to design the BO search space with the aid of tuning history from past tasks. This simple yet effective approach can be used to endow many existing BO methods with transfer learning capabilities. In addition, it enjoys the three advantages: universality, generality, and safeness. The extensive experiments show that our approach considerably boosts BO by designing a promising and compact search space instead of using the entire space, and outperforms the state-of-the-arts on a wide range of benchmarks, including machine learning and deep learning tuning tasks, and neural architecture search.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Li, Y., Shen, Y., Jiang, H., Bai, T., Zhang, W., Zhang, C., & Cui, B. (2022). Transfer Learning based Search Space Design for Hyperparameter Tuning. ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), 967–977. https://doi.org/10.1145/3534678.3539369
MLA 9
Li, Yang, et al. “Transfer Learning based Search Space Design for Hyperparameter Tuning.” ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), 2022, pp. 967–977. https://doi.org/10.1145/3534678.3539369.
Chicago
Li, Yang, Yu Shen, Huaijun Jiang, Tianyi Bai, Wentao Zhang, Ce Zhang, and Bin Cui. 2022. “Transfer Learning based Search Space Design for Hyperparameter Tuning.” ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD): 967–977. https://doi.org/10.1145/3534678.3539369.
Harvard
Li, Y. et al. (2022) ‘Transfer Learning based Search Space Design for Hyperparameter Tuning’, ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), pp. 967–977. doi:10.1145/3534678.3539369.
IEEE
Y. Li et al., “Transfer Learning based Search Space Design for Hyperparameter Tuning,” ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), pp. 967–977, 2022, doi: 10.1145/3534678.3539369.
BibTeX
@inproceedings{li2022transfer,
title = {{Transfer Learning based Search Space Design for Hyperparameter Tuning}},
author = {Li, Yang and Shen, Yu and Jiang, Huaijun and Bai, Tianyi and Zhang, Wentao and Zhang, Ce and Cui, Bin},
booktitle = {ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD)},
year = {2022},
pages = {967--977},
doi = {10.1145/3534678.3539369},
url = {https://doi.org/10.1145/3534678.3539369}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2022 | 1 | |
| 2023 | 7 | |
| 2024 | 4 | |
| 2025 | 7 | |
| 2026 | 6 |
Its field-weighted citation impact is 1.29: it has been cited 1.29 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- hyperparameter optimization
- Bayesian optimization
- transfer learning
- search space design
- neural architecture search
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Li, Y., Shen, Y., Jiang, H., Bai, T., Zhang, W., Zhang, C., & Cui, B. (2022). Transfer Learning based Search Space Design for Hyperparameter Tuning. ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), 967–977. https://doi.org/10.1145/3534678.3539369
How many times has this paper been cited?
25 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.
Who wrote this paper?
Yang Li, Yu Shen, Huaijun Jiang, Tianyi Bai, Wentao Zhang, Ce Zhang, Bin Cui.
What is the DOI of this paper?
10.1145/3534678.3539369, permanently at https://doi.org/10.1145/3534678.3539369. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.