Conference paper · 2022 · Open access

Transfer Learning based Search Space Design for Hyperparameter Tuning

Yang Li, Yu Shen, Huaijun Jiang, Tianyi Bai, Wentao Zhang, Ce Zhang, Bin Cui

ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), 967–977 · Published 12 August 2022 · DOI 10.1145/3534678.3539369

Open PDFView at the publisherCite this paper

In brief

“Transfer Learning based Search Space Design for Hyperparameter Tuning” is a 2022 conference paper by Yang Li and 6 co-authors, published in ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD). OpenAlex counts 25 citations as of 19 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).

Citations
25
Most cited in
2023 (7)
Field-weighted impact
1.29
References
59
Authors
7

Abstract

The tuning of hyperparameters becomes increasingly important as machine learning (ML) models have been extensively applied in data mining applications. Among various approaches, Bayesian optimization (BO) is a successful methodology to tune hyperparameters automatically. While traditional methods optimize each tuning task in isolation, there has been recent interest in speeding up BO by transferring knowledge across previous tasks. In this work, we introduce an automatic method to design the BO search space with the aid of tuning history from past tasks. This simple yet effective approach can be used to endow many existing BO methods with transfer learning capabilities. In addition, it enjoys the three advantages: universality, generality, and safeness. The extensive experiments show that our approach considerably boosts BO by designing a promising and compact search space instead of using the entire space, and outperforms the state-of-the-arts on a wide range of benchmarks, including machine learning and deep learning tuning tasks, and neural architecture search.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Li, Y., Shen, Y., Jiang, H., Bai, T., Zhang, W., Zhang, C., & Cui, B. (2022). Transfer Learning based Search Space Design for Hyperparameter Tuning. ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), 967–977. https://doi.org/10.1145/3534678.3539369

MLA 9

Li, Yang, et al. “Transfer Learning based Search Space Design for Hyperparameter Tuning.” ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), 2022, pp. 967–977. https://doi.org/10.1145/3534678.3539369.

Chicago

Li, Yang, Yu Shen, Huaijun Jiang, Tianyi Bai, Wentao Zhang, Ce Zhang, and Bin Cui. 2022. “Transfer Learning based Search Space Design for Hyperparameter Tuning.” ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD): 967–977. https://doi.org/10.1145/3534678.3539369.

Harvard

Li, Y. et al. (2022) ‘Transfer Learning based Search Space Design for Hyperparameter Tuning’, ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), pp. 967–977. doi:10.1145/3534678.3539369.

IEEE

Y. Li et al., “Transfer Learning based Search Space Design for Hyperparameter Tuning,” ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), pp. 967–977, 2022, doi: 10.1145/3534678.3539369.

BibTeX

@inproceedings{li2022transfer,
  title     = {{Transfer Learning based Search Space Design for Hyperparameter Tuning}},
  author    = {Li, Yang and Shen, Yu and Jiang, Huaijun and Bai, Tianyi and Zhang, Wentao and Zhang, Ce and Cui, Bin},
  booktitle = {ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD)},
  year      = {2022},
  pages     = {967--977},
  doi       = {10.1145/3534678.3539369},
  url       = {https://doi.org/10.1145/3534678.3539369}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202211
202377
202444
202577
202666

Its field-weighted citation impact is 1.29: it has been cited 1.29 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification

  • hyperparameter optimization
  • Bayesian optimization
  • transfer learning
  • search space design
  • neural architecture search

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Li, Y., Shen, Y., Jiang, H., Bai, T., Zhang, W., Zhang, C., & Cui, B. (2022). Transfer Learning based Search Space Design for Hyperparameter Tuning. ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), 967–977. https://doi.org/10.1145/3534678.3539369

How many times has this paper been cited?

25 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

Yang Li, Yu Shen, Huaijun Jiang, Tianyi Bai, Wentao Zhang, Ce Zhang, Bin Cui.

What is the DOI of this paper?

10.1145/3534678.3539369, permanently at https://doi.org/10.1145/3534678.3539369. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.