Preprint · 2022 · Open access
HyperBO+: Pre-training a universal prior for Bayesian optimization with hierarchical Gaussian processes
arXiv (Cornell University) · Published 20 December 2022 · DOI 10.48550/arxiv.2212.10538
In brief
“HyperBO+: Pre-training a universal prior for Bayesian optimization with hierarchical Gaussian processes” is a 2022 preprint by Fan, Zhou and 2 co-authors, published in arXiv (Cornell University). OpenAlex counts 6 citations as of 19 November 2026. It is open access under a CC BY licence: the full text is free to read at arXiv (Cornell University).
- Citations
- 6
- Most cited in
- 2025 (2)
- References
- 30
- Authors
- 3
Abstract
Bayesian optimization (BO), while proved highly effective for many black-box function optimization tasks, requires practitioners to carefully select priors that well model their functions of interest. Rather than specifying by hand, researchers have investigated transfer learning based methods to automatically learn the priors, e.g. multi-task BO (Swersky et al., 2013), few-shot BO (Wistuba and Grabocka, 2021) and HyperBO (Wang et al., 2022). However, those prior learning methods typically assume that the input domains are the same for all tasks, weakening their ability to use observations on functions with different domains or generalize the learned priors to BO on different search spaces. In this work, we present HyperBO+: a pre-training approach for hierarchical Gaussian processes that enables the same prior to work universally for Bayesian optimization on functions with different domains. We propose a two-step pre-training method and analyze its appealing asymptotic properties and benefits to BO both theoretically and empirically. On real-world hyperparameter tuning tasks that involve multiple search spaces, we demonstrate that HyperBO+ is able to generalize to unseen search spaces and achieves lower regrets than competitive baselines.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Zhou, F., Han, X., & Wang, Z. (2022). HyperBO+: Pre-training a universal prior for Bayesian optimization with hierarchical Gaussian processes. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2212.10538
MLA 9
Zhou, Fan,, et al. “HyperBO+: Pre-training a universal prior for Bayesian optimization with hierarchical Gaussian processes.” arXiv (Cornell University), 2022. https://doi.org/10.48550/arxiv.2212.10538.
Chicago
Zhou, Fan,, Xinran Han, and Zi Wang. 2022. “HyperBO+: Pre-training a universal prior for Bayesian optimization with hierarchical Gaussian processes.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.2212.10538.
Harvard
Zhou, F., Han, X. and Wang, Z. (2022) ‘HyperBO+: Pre-training a universal prior for Bayesian optimization with hierarchical Gaussian processes’, arXiv (Cornell University). doi:10.48550/arxiv.2212.10538.
IEEE
F. Zhou, X. Han, and Z. Wang, “HyperBO+: Pre-training a universal prior for Bayesian optimization with hierarchical Gaussian processes,” arXiv (Cornell University), 2022, doi: 10.48550/arxiv.2212.10538.
BibTeX
@misc{zhou2022hyperbo,
title = {{HyperBO+: Pre-training a universal prior for Bayesian optimization with hierarchical Gaussian processes}},
author = {Zhou, Fan, and Han, Xinran and Wang, Zi},
howpublished = {arXiv (Cornell University)},
year = {2022},
doi = {10.48550/arxiv.2212.10538},
url = {https://doi.org/10.48550/arxiv.2212.10538}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2023 | 1 | |
| 2024 | 1 | |
| 2025 | 2 | |
| 2026 | 2 |
Topic and keywords
Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
- Bayesian optimization
- hierarchical Gaussian process
- prior learning
- pre-training
- transfer learning
- hyperparameter optimization
- asymptotic properties
- regret minimization
Work with this paper
Most-cited papers in Decision Sciences
- The PRISMA 2020 statement: an updated guideline for reporting systematic reviewsMatthew James Page, Joanne E. McKenzie, Patrick M. Bossuyt and 23 more · BMJ · 2021 · 144,919 citations
- Evaluating Structural Equation Models with Unobservable Variables and Measurement ErrorClaes Fornell, David F. Larcker · Journal of Marketing Research · 1981 · 118,336 citations
- Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternativesLi‐tze Hu, Peter M. Bentler · Structural Equation Modeling A Multidisciplinary Journal · 1999 · 117,461 citations
- Common method biases in behavioral research: A critical review of the literature and recommended remedies.Philip M. Podsakoff, SCOTT B. MACKENZIE, Jeong Yeon Lee and 1 more · Journal of Applied Psychology · 2003 · 89,248 citations
- Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statementDavid Moher, Alessandro Liberati, Jennifer Tetzlaff and 2 more · BMJ · 2009 · 85,524 citations
Questions about this paper
How do I cite this paper in APA style?
Zhou, F., Han, X., & Wang, Z. (2022). HyperBO+: Pre-training a universal prior for Bayesian optimization with hierarchical Gaussian processes. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2212.10538
How many times has this paper been cited?
6 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.
Who wrote this paper?
Fan, Zhou, Xinran Han, Zi Wang.
What is the DOI of this paper?
10.48550/arxiv.2212.10538, permanently at https://doi.org/10.48550/arxiv.2212.10538. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.