Journal article · 2023 · Open access
Surrogate Modeling for Bayesian Optimization Beyond a Single Gaussian Process
IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(9), 11283–11296 · Published 5 April 2023 · DOI 10.1109/tpami.2023.3264741
In brief
“Surrogate Modeling for Bayesian Optimization Beyond a Single Gaussian Process” is a 2023 journal article by Qin Lu and 3 co-authors, published in IEEE Transactions on Pattern Analysis and Machine Intelligence. OpenAlex counts 95 citations as of 19 November 2026, which puts it in the top 7% of works published in 2023 by citations. It is open access under a CC BY licence: the full text is free to read at arXiv (Cornell University).
- Citations
- 95
- Most cited in
- 2026 (40)
- Field-weighted impact
- 11.09
- References
- 51
- Authors
- 4
Abstract
Bayesian optimization (BO) has well-documented merits for optimizing black-box functions with an expensive evaluation cost. Such functions emerge in applications as diverse as hyperparameter tuning, drug discovery, and robotics. BO hinges on a Bayesian surrogate model to sequentially select query points so as to balance exploration with exploitation of the search space. Most existing works rely on a single Gaussian process (GP) based surrogate model, where the kernel function form is typically preselected using domain knowledge. To bypass such a design process, this paper leverages an ensemble (E) of GPs to adaptively select the surrogate model fit on-the-fly, yielding a GP mixture posterior with enhanced expressiveness for the sought function. Acquisition of the next evaluation input using this EGP-based function posterior is then enabled by Thompson sampling (TS) that requires no additional design parameters. To endow function sampling with scalability, random feature-based kernel approximation is leveraged per GP model. The novel EGP-TS readily accommodates parallel operation. To further establish convergence of the proposed EGP-TS to the global optimum, analysis is conducted based on the notion of Bayesian regret for both sequential and parallel settings. Tests on synthetic functions and real-world applications showcase the merits of the proposed method.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Lu, Q., Polyzos, K. D., Li, B., & Giannakis, G. B. (2023). Surrogate Modeling for Bayesian Optimization Beyond a Single Gaussian Process. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(9), 11283–11296. https://doi.org/10.1109/tpami.2023.3264741
MLA 9
Lu, Qin, et al. “Surrogate Modeling for Bayesian Optimization Beyond a Single Gaussian Process.” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 45, no. 9, 2023, pp. 11283–11296. https://doi.org/10.1109/tpami.2023.3264741.
Chicago
Lu, Qin, Konstantinos D. Polyzos, Bingcong Li, and Georgios B. Giannakis. 2023. “Surrogate Modeling for Bayesian Optimization Beyond a Single Gaussian Process.” IEEE Transactions on Pattern Analysis and Machine Intelligence 45 (9): 11283–11296. https://doi.org/10.1109/tpami.2023.3264741.
Harvard
Lu, Q. et al. (2023) ‘Surrogate Modeling for Bayesian Optimization Beyond a Single Gaussian Process’, IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(9), pp. 11283–11296. doi:10.1109/tpami.2023.3264741.
IEEE
Q. Lu, K. D. Polyzos, B. Li, and G. B. Giannakis, “Surrogate Modeling for Bayesian Optimization Beyond a Single Gaussian Process,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 45, no. 9, pp. 11283–11296, 2023, doi: 10.1109/tpami.2023.3264741.
BibTeX
@article{lu2023surrogate,
title = {{Surrogate Modeling for Bayesian Optimization Beyond a Single Gaussian Process}},
author = {Lu, Qin and Polyzos, Konstantinos D. and Li, Bingcong and Giannakis, Georgios B.},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2023},
volume = {45},
number = {9},
pages = {11283--11296},
doi = {10.1109/tpami.2023.3264741},
url = {https://doi.org/10.1109/tpami.2023.3264741}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2022 | 2 | |
| 2023 | 5 | |
| 2024 | 14 | |
| 2025 | 34 | |
| 2026 | 40 |
Its field-weighted citation impact is 11.09: it has been cited 11.09 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
- Bayesian optimization
- surrogate models
- Thompson sampling
- kernel selection
- Bayesian regret
- black-box optimization
- exploration-exploitation balance
Work with this paper
Most-cited papers in Decision Sciences
- The PRISMA 2020 statement: an updated guideline for reporting systematic reviewsMatthew James Page, Joanne E. McKenzie, Patrick M. Bossuyt and 23 more · BMJ · 2021 · 144,919 citations
- Evaluating Structural Equation Models with Unobservable Variables and Measurement ErrorClaes Fornell, David F. Larcker · Journal of Marketing Research · 1981 · 118,336 citations
- Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternativesLi‐tze Hu, Peter M. Bentler · Structural Equation Modeling A Multidisciplinary Journal · 1999 · 117,461 citations
- Common method biases in behavioral research: A critical review of the literature and recommended remedies.Philip M. Podsakoff, SCOTT B. MACKENZIE, Jeong Yeon Lee and 1 more · Journal of Applied Psychology · 2003 · 89,248 citations
- Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statementDavid Moher, Alessandro Liberati, Jennifer Tetzlaff and 2 more · BMJ · 2009 · 85,524 citations
Questions about this paper
How do I cite this paper in APA style?
Lu, Q., Polyzos, K. D., Li, B., & Giannakis, G. B. (2023). Surrogate Modeling for Bayesian Optimization Beyond a Single Gaussian Process. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(9), 11283–11296. https://doi.org/10.1109/tpami.2023.3264741
How many times has this paper been cited?
95 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.
Who wrote this paper?
Qin Lu, Konstantinos D. Polyzos, Bingcong Li, Georgios B. Giannakis.
What is the DOI of this paper?
10.1109/tpami.2023.3264741, permanently at https://doi.org/10.1109/tpami.2023.3264741. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.