Preprint · 2017 · Open access

Exploiting gradients and Hessians in Bayesian optimization and Bayesian quadrature

Anqi Wu, Mikio Aoi, Jonathan W. Pillow

arXiv (Cornell University) · Published 31 March 2017 · DOI 10.48550/arxiv.1704.00060

Open PDFView at the publisherCite this paper

In brief

“Exploiting gradients and Hessians in Bayesian optimization and Bayesian quadrature” is a 2017 preprint by Anqi Wu and 2 co-authors, published in arXiv (Cornell University). OpenAlex counts 51 citations as of 19 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).

Citations
51
Most cited in
2019 (7)
References
26
Authors
3

Abstract

An exciting branch of machine learning research focuses on methods for learning, optimizing, and integrating unknown functions that are difficult or costly to evaluate. A popular Bayesian approach to this problem uses a Gaussian process (GP) to construct a posterior distribution over the function of interest given a set of observed measurements, and selects new points to evaluate using the statistics of this posterior. Here we extend these methods to exploit derivative information from the unknown function. We describe methods for Bayesian optimization (BO) and Bayesian quadrature (BQ) in settings where first and second derivatives may be evaluated along with the function itself. We perform sampling-based inference in order to incorporate uncertainty over hyperparameters, and show that both hyperparameter and function uncertainty decrease much more rapidly when using derivative information. Moreover, we introduce techniques for overcoming ill-conditioning issues that have plagued earlier methods for gradient-enhanced Gaussian processes and kriging. We illustrate the efficacy of these methods using applications to real and simulated Bayesian optimization and quadrature problems, and show that exploting derivatives can provide substantial gains over standard methods.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Wu, A., Aoi, M., & Pillow, J. W. (2017). Exploiting gradients and Hessians in Bayesian optimization and Bayesian quadrature. arXiv (Cornell University). https://doi.org/10.48550/arxiv.1704.00060

MLA 9

Wu, Anqi, et al. “Exploiting gradients and Hessians in Bayesian optimization and Bayesian quadrature.” arXiv (Cornell University), 2017. https://doi.org/10.48550/arxiv.1704.00060.

Chicago

Wu, Anqi, Mikio Aoi, and Jonathan W. Pillow. 2017. “Exploiting gradients and Hessians in Bayesian optimization and Bayesian quadrature.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.1704.00060.

Harvard

Wu, A., Aoi, M. and Pillow, J. W. (2017) ‘Exploiting gradients and Hessians in Bayesian optimization and Bayesian quadrature’, arXiv (Cornell University). doi:10.48550/arxiv.1704.00060.

IEEE

A. Wu, M. Aoi, and J. W. Pillow, “Exploiting gradients and Hessians in Bayesian optimization and Bayesian quadrature,” arXiv (Cornell University), 2017, doi: 10.48550/arxiv.1704.00060.

BibTeX

@misc{wu2017exploiting,
  title     = {{Exploiting gradients and Hessians in Bayesian optimization and Bayesian quadrature}},
  author    = {Wu, Anqi and Aoi, Mikio and Pillow, Jonathan W.},
  howpublished = {arXiv (Cornell University)},
  year      = {2017},
  doi       = {10.48550/arxiv.1704.00060},
  url       = {https://doi.org/10.48550/arxiv.1704.00060}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
201733
201811
201977
202066
202177
202266
202366
202455
202544
202666

Topic and keywords

Physical Sciences › Computer Science › Artificial Intelligence › Gaussian Processes and Bayesian Inference

  • Bayesian optimization
  • Bayesian quadrature
  • Hessian information
  • derivative information
  • kriging
  • sampling-based inference
  • ill-conditioning
  • expensive function evaluations

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Wu, A., Aoi, M., & Pillow, J. W. (2017). Exploiting gradients and Hessians in Bayesian optimization and Bayesian quadrature. arXiv (Cornell University). https://doi.org/10.48550/arxiv.1704.00060

How many times has this paper been cited?

51 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

Anqi Wu, Mikio Aoi, Jonathan W. Pillow.

What is the DOI of this paper?

10.48550/arxiv.1704.00060, permanently at https://doi.org/10.48550/arxiv.1704.00060. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.