Preprint · 2021 · Open access

Bayesian Optimization of Function Networks

Raul Astudillo, Peter I. Frazier

arXiv (Cornell University), 34 · Published 31 December 2021 · DOI 10.48550/arxiv.2112.15311

Open PDFView at the publisherCite this paper

In brief

“Bayesian Optimization of Function Networks” is a 2021 preprint by Raul Astudillo and Peter I. Frazier, published in arXiv (Cornell University). OpenAlex counts 26 citations as of 19 November 2026. It is open access under a CC BY licence: the full text is free to read at arXiv (Cornell University).

Citations
26
Most cited in
2023 (9)
References
54
Authors
2

Abstract

We consider Bayesian optimization of the output of a network of functions, where each function takes as input the output of its parent nodes, and where the network takes significant time to evaluate. Such problems arise, for example, in reinforcement learning, engineering design, and manufacturing. While the standard Bayesian optimization approach observes only the final output, our approach delivers greater query efficiency by leveraging information that the former ignores: intermediate output within the network. This is achieved by modeling the nodes of the network using Gaussian processes and choosing the points to evaluate using, as our acquisition function, the expected improvement computed with respect to the implied posterior on the objective. Although the non-Gaussian nature of this posterior prevents computing our acquisition function in closed form, we show that it can be efficiently maximized via sample average approximation. In addition, we prove that our method is asymptotically consistent, meaning that it finds a globally optimal solution as the number of evaluations grows to infinity, thus generalizing previously known convergence results for the expected improvement. Notably, this holds even though our method might not evaluate the domain densely, instead leveraging problem structure to leave regions unexplored. Finally, we show that our approach dramatically outperforms standard Bayesian optimization methods in several synthetic and real-world problems.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Astudillo, R., & Frazier, P. I. (2021). Bayesian Optimization of Function Networks. arXiv (Cornell University), 34. https://doi.org/10.48550/arxiv.2112.15311

MLA 9

Astudillo, Raul, and Peter I. Frazier. “Bayesian Optimization of Function Networks.” arXiv (Cornell University), vol. 34, 2021. https://doi.org/10.48550/arxiv.2112.15311.

Chicago

Astudillo, Raul and Peter I. Frazier. 2021. “Bayesian Optimization of Function Networks.” arXiv (Cornell University) 34. https://doi.org/10.48550/arxiv.2112.15311.

Harvard

Astudillo, R. and Frazier, P. I. (2021) ‘Bayesian Optimization of Function Networks’, arXiv (Cornell University), 34. doi:10.48550/arxiv.2112.15311.

IEEE

R. Astudillo and P. I. Frazier, “Bayesian Optimization of Function Networks,” arXiv (Cornell University), vol. 34, 2021, doi: 10.48550/arxiv.2112.15311.

BibTeX

@misc{astudillo2021bayesian,
  title     = {{Bayesian Optimization of Function Networks}},
  author    = {Astudillo, Raul and Frazier, Peter I.},
  howpublished = {arXiv (Cornell University)},
  year      = {2021},
  volume    = {34},
  doi       = {10.48550/arxiv.2112.15311},
  url       = {https://doi.org/10.48550/arxiv.2112.15311}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202222
202399
202455
202544
202666

Topic and keywords

Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research

  • Bayesian optimization
  • intermediate outputs
  • Gaussian processes
  • expected improvement
  • acquisition functions
  • sample average approximation
  • asymptotic consistency
  • expensive-to-evaluate functions

Work with this paper

Most-cited papers in Decision Sciences

All highly cited Decision Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Astudillo, R., & Frazier, P. I. (2021). Bayesian Optimization of Function Networks. arXiv (Cornell University), 34. https://doi.org/10.48550/arxiv.2112.15311

How many times has this paper been cited?

26 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

Raul Astudillo, Peter I. Frazier.

What is the DOI of this paper?

10.48550/arxiv.2112.15311, permanently at https://doi.org/10.48550/arxiv.2112.15311. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.