Preprint · 2021 · Open access
Neural Process for Black-Box Model Optimization Under Bayesian Framework
arXiv (Cornell University) · Published 3 April 2021 · DOI 10.48550/arxiv.2104.02487
In brief
“Neural Process for Black-Box Model Optimization Under Bayesian Framework” is a 2021 preprint by Zhongkai Shangguan and 3 co-authors, published in arXiv (Cornell University). OpenAlex counts 22 citations as of 19 November 2026. It is open access under a public domain licence: the full text is free to read at arXiv (Cornell University).
- Citations
- 22
- Most cited in
- 2024 (10)
- References
- 31
- Authors
- 4
Abstract
There are a large number of optimization problems in physical models where the relationships between model parameters and outputs are unknown or hard to track. These models are named as black-box models in general because they can only be viewed in terms of inputs and outputs, without knowledge of the internal workings. Optimizing the black-box model parameters has become increasingly expensive and time consuming as they have become more complex. Hence, developing effective and efficient black-box model optimization algorithms has become an important task. One powerful algorithm to solve such problem is Bayesian optimization, which can effectively estimates the model parameters that lead to the best performance, and Gaussian Process (GP) has been one of the most widely used surrogate model in Bayesian optimization. However, the time complexity of GP scales cubically with respect to the number of observed model outputs, and GP does not scale well with large parameter dimension either. Consequently, it has been challenging for GP to optimize black-box models that need to query many observations and/or have many parameters. To overcome the drawbacks of GP, in this study, we propose a general Bayesian optimization algorithm that employs a Neural Process (NP) as the surrogate model to perform black-box model optimization, namely, Neural Process for Bayesian Optimization (NPBO). In order to validate the benefits of NPBO, we compare NPBO with four benchmark approaches on a power system parameter optimization problem and a series of seven benchmark Bayesian optimization problems. The results show that the proposed NPBO performs better than the other four benchmark approaches on the power system parameter optimization problem and competitively on the seven benchmark problems.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Shangguan, Z., Lin, L., Wu, W., & Xu, B. (2021). Neural Process for Black-Box Model Optimization Under Bayesian Framework. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2104.02487
MLA 9
Shangguan, Zhongkai, et al. “Neural Process for Black-Box Model Optimization Under Bayesian Framework.” arXiv (Cornell University), 2021. https://doi.org/10.48550/arxiv.2104.02487.
Chicago
Shangguan, Zhongkai, Lei Lin, Wencheng Wu, and Beilei Xu. 2021. “Neural Process for Black-Box Model Optimization Under Bayesian Framework.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.2104.02487.
Harvard
Shangguan, Z. et al. (2021) ‘Neural Process for Black-Box Model Optimization Under Bayesian Framework’, arXiv (Cornell University). doi:10.48550/arxiv.2104.02487.
IEEE
Z. Shangguan, L. Lin, W. Wu, and B. Xu, “Neural Process for Black-Box Model Optimization Under Bayesian Framework,” arXiv (Cornell University), 2021, doi: 10.48550/arxiv.2104.02487.
BibTeX
@misc{shangguan2021neural,
title = {{Neural Process for Black-Box Model Optimization Under Bayesian Framework}},
author = {Shangguan, Zhongkai and Lin, Lei and Wu, Wencheng and Xu, Beilei},
howpublished = {arXiv (Cornell University)},
year = {2021},
doi = {10.48550/arxiv.2104.02487},
url = {https://doi.org/10.48550/arxiv.2104.02487}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2021 | 1 | |
| 2022 | 4 | |
| 2023 | 3 | |
| 2024 | 10 | |
| 2025 | 3 | |
| 2026 | 1 |
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Gaussian Processes and Bayesian Inference
- neural processes
- Bayesian optimization
- surrogate models
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Shangguan, Z., Lin, L., Wu, W., & Xu, B. (2021). Neural Process for Black-Box Model Optimization Under Bayesian Framework. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2104.02487
How many times has this paper been cited?
22 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.
Who wrote this paper?
Zhongkai Shangguan, Lei Lin, Wencheng Wu, Beilei Xu.
What is the DOI of this paper?
10.48550/arxiv.2104.02487, permanently at https://doi.org/10.48550/arxiv.2104.02487. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.