Preprint · 2017 · Open access
Exploiting gradients and Hessians in Bayesian optimization and Bayesian quadrature
arXiv (Cornell University) · Published 31 March 2017 · DOI 10.48550/arxiv.1704.00060
In brief
“Exploiting gradients and Hessians in Bayesian optimization and Bayesian quadrature” is a 2017 preprint by Anqi Wu and 2 co-authors, published in arXiv (Cornell University). OpenAlex counts 51 citations as of 19 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).
- Citations
- 51
- Most cited in
- 2019 (7)
- References
- 26
- Authors
- 3
Abstract
An exciting branch of machine learning research focuses on methods for learning, optimizing, and integrating unknown functions that are difficult or costly to evaluate. A popular Bayesian approach to this problem uses a Gaussian process (GP) to construct a posterior distribution over the function of interest given a set of observed measurements, and selects new points to evaluate using the statistics of this posterior. Here we extend these methods to exploit derivative information from the unknown function. We describe methods for Bayesian optimization (BO) and Bayesian quadrature (BQ) in settings where first and second derivatives may be evaluated along with the function itself. We perform sampling-based inference in order to incorporate uncertainty over hyperparameters, and show that both hyperparameter and function uncertainty decrease much more rapidly when using derivative information. Moreover, we introduce techniques for overcoming ill-conditioning issues that have plagued earlier methods for gradient-enhanced Gaussian processes and kriging. We illustrate the efficacy of these methods using applications to real and simulated Bayesian optimization and quadrature problems, and show that exploting derivatives can provide substantial gains over standard methods.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Wu, A., Aoi, M., & Pillow, J. W. (2017). Exploiting gradients and Hessians in Bayesian optimization and Bayesian quadrature. arXiv (Cornell University). https://doi.org/10.48550/arxiv.1704.00060
MLA 9
Wu, Anqi, et al. “Exploiting gradients and Hessians in Bayesian optimization and Bayesian quadrature.” arXiv (Cornell University), 2017. https://doi.org/10.48550/arxiv.1704.00060.
Chicago
Wu, Anqi, Mikio Aoi, and Jonathan W. Pillow. 2017. “Exploiting gradients and Hessians in Bayesian optimization and Bayesian quadrature.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.1704.00060.
Harvard
Wu, A., Aoi, M. and Pillow, J. W. (2017) ‘Exploiting gradients and Hessians in Bayesian optimization and Bayesian quadrature’, arXiv (Cornell University). doi:10.48550/arxiv.1704.00060.
IEEE
A. Wu, M. Aoi, and J. W. Pillow, “Exploiting gradients and Hessians in Bayesian optimization and Bayesian quadrature,” arXiv (Cornell University), 2017, doi: 10.48550/arxiv.1704.00060.
BibTeX
@misc{wu2017exploiting,
title = {{Exploiting gradients and Hessians in Bayesian optimization and Bayesian quadrature}},
author = {Wu, Anqi and Aoi, Mikio and Pillow, Jonathan W.},
howpublished = {arXiv (Cornell University)},
year = {2017},
doi = {10.48550/arxiv.1704.00060},
url = {https://doi.org/10.48550/arxiv.1704.00060}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2017 | 3 | |
| 2018 | 1 | |
| 2019 | 7 | |
| 2020 | 6 | |
| 2021 | 7 | |
| 2022 | 6 | |
| 2023 | 6 | |
| 2024 | 5 | |
| 2025 | 4 | |
| 2026 | 6 |
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Gaussian Processes and Bayesian Inference
- Bayesian optimization
- Bayesian quadrature
- Hessian information
- derivative information
- kriging
- sampling-based inference
- ill-conditioning
- expensive function evaluations
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Wu, A., Aoi, M., & Pillow, J. W. (2017). Exploiting gradients and Hessians in Bayesian optimization and Bayesian quadrature. arXiv (Cornell University). https://doi.org/10.48550/arxiv.1704.00060
How many times has this paper been cited?
51 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.
Who wrote this paper?
Anqi Wu, Mikio Aoi, Jonathan W. Pillow.
What is the DOI of this paper?
10.48550/arxiv.1704.00060, permanently at https://doi.org/10.48550/arxiv.1704.00060. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.