Preprint · 2022 · Open access

HyperBO+: Pre-training a universal prior for Bayesian optimization with hierarchical Gaussian processes

Fan, Zhou, Xinran Han, Zi Wang

arXiv (Cornell University) · Published 20 December 2022 · DOI 10.48550/arxiv.2212.10538

Open PDFView at the publisherCite this paper

In brief

“HyperBO+: Pre-training a universal prior for Bayesian optimization with hierarchical Gaussian processes” is a 2022 preprint by Fan, Zhou and 2 co-authors, published in arXiv (Cornell University). OpenAlex counts 6 citations as of 19 November 2026. It is open access under a CC BY licence: the full text is free to read at arXiv (Cornell University).

Citations
6
Most cited in
2025 (2)
References
30
Authors
3

Abstract

Bayesian optimization (BO), while proved highly effective for many black-box function optimization tasks, requires practitioners to carefully select priors that well model their functions of interest. Rather than specifying by hand, researchers have investigated transfer learning based methods to automatically learn the priors, e.g. multi-task BO (Swersky et al., 2013), few-shot BO (Wistuba and Grabocka, 2021) and HyperBO (Wang et al., 2022). However, those prior learning methods typically assume that the input domains are the same for all tasks, weakening their ability to use observations on functions with different domains or generalize the learned priors to BO on different search spaces. In this work, we present HyperBO+: a pre-training approach for hierarchical Gaussian processes that enables the same prior to work universally for Bayesian optimization on functions with different domains. We propose a two-step pre-training method and analyze its appealing asymptotic properties and benefits to BO both theoretically and empirically. On real-world hyperparameter tuning tasks that involve multiple search spaces, we demonstrate that HyperBO+ is able to generalize to unseen search spaces and achieves lower regrets than competitive baselines.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Zhou, F., Han, X., & Wang, Z. (2022). HyperBO+: Pre-training a universal prior for Bayesian optimization with hierarchical Gaussian processes. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2212.10538

MLA 9

Zhou, Fan,, et al. “HyperBO+: Pre-training a universal prior for Bayesian optimization with hierarchical Gaussian processes.” arXiv (Cornell University), 2022. https://doi.org/10.48550/arxiv.2212.10538.

Chicago

Zhou, Fan,, Xinran Han, and Zi Wang. 2022. “HyperBO+: Pre-training a universal prior for Bayesian optimization with hierarchical Gaussian processes.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.2212.10538.

Harvard

Zhou, F., Han, X. and Wang, Z. (2022) ‘HyperBO+: Pre-training a universal prior for Bayesian optimization with hierarchical Gaussian processes’, arXiv (Cornell University). doi:10.48550/arxiv.2212.10538.

IEEE

F. Zhou, X. Han, and Z. Wang, “HyperBO+: Pre-training a universal prior for Bayesian optimization with hierarchical Gaussian processes,” arXiv (Cornell University), 2022, doi: 10.48550/arxiv.2212.10538.

BibTeX

@misc{zhou2022hyperbo,
  title     = {{HyperBO+: Pre-training a universal prior for Bayesian optimization with hierarchical Gaussian processes}},
  author    = {Zhou, Fan, and Han, Xinran and Wang, Zi},
  howpublished = {arXiv (Cornell University)},
  year      = {2022},
  doi       = {10.48550/arxiv.2212.10538},
  url       = {https://doi.org/10.48550/arxiv.2212.10538}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202311
202411
202522
202622

Topic and keywords

Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research

  • Bayesian optimization
  • hierarchical Gaussian process
  • prior learning
  • pre-training
  • transfer learning
  • hyperparameter optimization
  • asymptotic properties
  • regret minimization

Work with this paper

Most-cited papers in Decision Sciences

All highly cited Decision Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Zhou, F., Han, X., & Wang, Z. (2022). HyperBO+: Pre-training a universal prior for Bayesian optimization with hierarchical Gaussian processes. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2212.10538

How many times has this paper been cited?

6 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

Fan, Zhou, Xinran Han, Zi Wang.

What is the DOI of this paper?

10.48550/arxiv.2212.10538, permanently at https://doi.org/10.48550/arxiv.2212.10538. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.