Preprint · 2017 · Open access

Bayesian Optimization with Gradients

Wu, Jian, Matthias Poloczek, Andrew Gordon Wilson, Peter I. Frazier

arXiv (Cornell University), 30, 5267–5278 · Published 13 March 2017 · DOI 10.48550/arxiv.1703.04389

Open PDFView at the publisherCite this paper

In brief

“Bayesian Optimization with Gradients” is a 2017 preprint by Wu, Jian and 3 co-authors, published in arXiv (Cornell University). OpenAlex counts 220 citations as of 19 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).

Citations
220
Most cited in
2021 (33)
References
41
Authors
4

Abstract

Bayesian optimization has been successful at global optimization of expensive-to-evaluate multimodal objective functions. However, unlike most optimization methods, Bayesian optimization typically does not use derivative information. In this paper we show how Bayesian optimization can exploit derivative information to decrease the number of objective function evaluations required for good performance. In particular, we develop a novel Bayesian optimization algorithm, the derivative-enabled knowledge-gradient (dKG), for which we show one-step Bayes-optimality, asymptotic consistency, and greater one-step value of information than is possible in the derivative-free setting. Our procedure accommodates noisy and incomplete derivative information, comes in both sequential and batch forms, and can optionally reduce the computational cost of inference through automatically selected retention of a single directional derivative. We also compute the d-KG acquisition function and its gradient using a novel fast discretization-free technique. We show d-KG provides state-of-the-art performance compared to a wide range of optimization procedures with and without gradients, on benchmarks including logistic regression, deep learning, kernel learning, and k-nearest neighbors.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Jian, W., Poloczek, M., Wilson, A. G., & Frazier, P. I. (2017). Bayesian Optimization with Gradients. arXiv (Cornell University), 30, 5267–5278. https://doi.org/10.48550/arxiv.1703.04389

MLA 9

Jian, Wu,, et al. “Bayesian Optimization with Gradients.” arXiv (Cornell University), vol. 30, 2017, pp. 5267–5278. https://doi.org/10.48550/arxiv.1703.04389.

Chicago

Jian, Wu,, Matthias Poloczek, Andrew Gordon Wilson, and Peter I. Frazier. 2017. “Bayesian Optimization with Gradients.” arXiv (Cornell University) 30: 5267–5278. https://doi.org/10.48550/arxiv.1703.04389.

Harvard

Jian, W. et al. (2017) ‘Bayesian Optimization with Gradients’, arXiv (Cornell University), 30, pp. 5267–5278. doi:10.48550/arxiv.1703.04389.

IEEE

W. Jian, M. Poloczek, A. G. Wilson, and P. I. Frazier, “Bayesian Optimization with Gradients,” arXiv (Cornell University), vol. 30, pp. 5267–5278, 2017, doi: 10.48550/arxiv.1703.04389.

BibTeX

@misc{jian2017bayesian,
  title     = {{Bayesian Optimization with Gradients}},
  author    = {Jian, Wu, and Poloczek, Matthias and Wilson, Andrew Gordon and Frazier, Peter I.},
  howpublished = {arXiv (Cornell University)},
  year      = {2017},
  volume    = {30},
  pages     = {5267--5278},
  doi       = {10.48550/arxiv.1703.04389},
  url       = {https://doi.org/10.48550/arxiv.1703.04389}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
201755
20182222
20192828
20202929
20213333
20221616
20232323
20242626
20252020
20261818

Topic and keywords

Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research

  • Bayesian optimization
  • gradient information
  • acquisition functions
  • value of information
  • batch optimization
  • expensive-to-evaluate functions
  • global optimization
  • asymptotic consistency

Work with this paper

Most-cited papers in Decision Sciences

All highly cited Decision Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Jian, W., Poloczek, M., Wilson, A. G., & Frazier, P. I. (2017). Bayesian Optimization with Gradients. arXiv (Cornell University), 30, 5267–5278. https://doi.org/10.48550/arxiv.1703.04389

How many times has this paper been cited?

220 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

Wu, Jian, Matthias Poloczek, Andrew Gordon Wilson, Peter I. Frazier.

What is the DOI of this paper?

10.48550/arxiv.1703.04389, permanently at https://doi.org/10.48550/arxiv.1703.04389. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.