Journal article · 2026 · Open access

Efficient Gradient‐Enhanced Bayesian Optimizer with Comparisons to Conjugate‐Gradient and Quasi‐Newton Optimizers for Unconstrained Local Optimization

André L. Marchildon, David W. Zingg

International Journal for Numerical Methods in Engineering, 127(4) · Published 12 February 2026 · DOI 10.1002/nme.70275

Open full textCite this paper

In brief

“Efficient Gradient‐Enhanced Bayesian Optimizer with Comparisons to Conjugate‐Gradient and Quasi‐Newton Optimizers for Unconstrained Local Optimization” is a 2026 journal article by André L. Marchildon and David W. Zingg, published in International Journal for Numerical Methods in Engineering. OpenAlex counts 4 citations as of 19 November 2026, which puts it in the top 8% of works published in 2026 by citations. It is open access under a CC BY licence: the full text is free to read at International Journal for Numerical Methods in Engineering.

Citations
4
Most cited in
2025 (2)
Field-weighted impact
3.29
References
56
Authors
2

Abstract

The probabilistic surrogates used by Bayesian optimizers make them popular methods when function evaluations are noisy or expensive to evaluate. While Bayesian optimizers are traditionally used for global optimization, their benefits are also valuable for local optimization. In this paper, a framework for gradient‐enhanced unconstrained local Bayesian optimization is presented. It involves selecting a subset of the evaluation points to construct the surrogate and using a probabilistic trust region for the minimization of the acquisition function. The Bayesian optimizer is compared to conjugate‐gradient and quasi‐Newton optimizers from MATLAB and SciPy for unimodal problems with 2 to 40 dimensions. The Bayesian optimizer converges the optimality as deeply as the optimizers used for comparison and often does so using significantly fewer function evaluations. For the minimization of the 40‐dimensional Rosenbrock function for example, the Bayesian optimizer requires half as many function evaluations as the MATLAB and SciPy optimizers to reduce the optimality by 10 orders of magnitude. For test cases with noisy gradients, the probabilistic surrogate of the Bayesian optimizer enables it to converge the optimality several additional orders of magnitude relative to the conjugate‐gradient and quasi‐Newton optimizers. The final test case involves the chaotic Lorenz 63 model and inaccurate gradients. For this problem, the Bayesian optimizer achieves a lower final objective evaluation than the SciPy quasi‐Newton optimizer for all initial starting solutions. The results demonstrate that a Bayesian optimizer can be competitive with quasi‐Newton and conjugate‐gradient optimizers when accurate gradients are available, and significantly outperforms them when the gradients are inaccurate.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Marchildon, A. L., & Zingg, D. W. (2026). Efficient Gradient‐Enhanced Bayesian Optimizer with Comparisons to Conjugate‐Gradient and Quasi‐Newton Optimizers for Unconstrained Local Optimization. International Journal for Numerical Methods in Engineering, 127(4). https://doi.org/10.1002/nme.70275

MLA 9

Marchildon, André L., and David W. Zingg. “Efficient Gradient‐Enhanced Bayesian Optimizer with Comparisons to Conjugate‐Gradient and Quasi‐Newton Optimizers for Unconstrained Local Optimization.” International Journal for Numerical Methods in Engineering, vol. 127, no. 4, 2026. https://doi.org/10.1002/nme.70275.

Chicago

Marchildon, André L. and David W. Zingg. 2026. “Efficient Gradient‐Enhanced Bayesian Optimizer with Comparisons to Conjugate‐Gradient and Quasi‐Newton Optimizers for Unconstrained Local Optimization.” International Journal for Numerical Methods in Engineering 127 (4). https://doi.org/10.1002/nme.70275.

Harvard

Marchildon, A. L. and Zingg, D. W. (2026) ‘Efficient Gradient‐Enhanced Bayesian Optimizer with Comparisons to Conjugate‐Gradient and Quasi‐Newton Optimizers for Unconstrained Local Optimization’, International Journal for Numerical Methods in Engineering, 127(4). doi:10.1002/nme.70275.

IEEE

A. L. Marchildon and D. W. Zingg, “Efficient Gradient‐Enhanced Bayesian Optimizer with Comparisons to Conjugate‐Gradient and Quasi‐Newton Optimizers for Unconstrained Local Optimization,” International Journal for Numerical Methods in Engineering, vol. 127, no. 4, 2026, doi: 10.1002/nme.70275.

BibTeX

@article{marchildon2026efficient,
  title     = {{Efficient Gradient‐Enhanced Bayesian Optimizer with Comparisons to Conjugate‐Gradient and Quasi‐Newton Optimizers for Unconstrained Local Optimization}},
  author    = {Marchildon, André L. and Zingg, David W.},
  journal   = {International Journal for Numerical Methods in Engineering},
  year      = {2026},
  volume    = {127},
  number    = {4},
  doi       = {10.1002/nme.70275},
  url       = {https://doi.org/10.1002/nme.70275}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Physical Sciences › Computer Science › Computational Theory and Mathematics › Advanced Multi-Objective Optimization Algorithms

  • Bayesian optimization
  • conjugate gradient method
  • quasi-Newton methods
  • noisy gradients
  • Rosenbrock function
  • Lorenz 63 model
  • expensive function evaluations

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Marchildon, A. L., & Zingg, D. W. (2026). Efficient Gradient‐Enhanced Bayesian Optimizer with Comparisons to Conjugate‐Gradient and Quasi‐Newton Optimizers for Unconstrained Local Optimization. International Journal for Numerical Methods in Engineering, 127(4). https://doi.org/10.1002/nme.70275

How many times has this paper been cited?

4 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at International Journal for Numerical Methods in Engineering: sign in and open the full text from this page.

Who wrote this paper?

André L. Marchildon, David W. Zingg.

What is the DOI of this paper?

10.1002/nme.70275, permanently at https://doi.org/10.1002/nme.70275. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.