Journal article · 2016 · Open access

Extending Expected Improvement for High-Dimensional Stochastic Optimization of Expensive Black-Box Functions

Piyush Pandita, Ilias Bilionis, Jitesh H. Panchal

Journal of Mechanical Design, 138(11) · Published 13 July 2016 · DOI 10.1115/1.4034104

Open PDFView at the publisherCite this paper

In brief

“Extending Expected Improvement for High-Dimensional Stochastic Optimization of Expensive Black-Box Functions” is a 2016 journal article by Piyush Pandita and 2 co-authors, published in Journal of Mechanical Design. OpenAlex counts 17 citations as of 19 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).

Citations
17
Most cited in
2021 (5)
Field-weighted impact
1.47
References
45
Authors
3

Abstract

Design optimization under uncertainty is notoriously difficult when the objective function is expensive to evaluate. State-of-the-art techniques, e.g., stochastic optimization or sampling average approximation, fail to learn exploitable patterns from collected data and require a lot of objective function evaluations. There is a need for techniques that alleviate the high cost of information acquisition and select sequential simulations optimally. In the field of deterministic single-objective unconstrained global optimization, the Bayesian global optimization (BGO) approach has been relatively successful in addressing the information acquisition problem. BGO builds a probabilistic surrogate of the expensive objective function and uses it to define an information acquisition function (IAF) that quantifies the merit of making new objective evaluations. In this work, we reformulate the expected improvement (EI) IAF to filter out parametric and measurement uncertainties. We bypass the curse of dimensionality, since the method does not require learning the response surface as a function of the stochastic parameters, and we employ a fully Bayesian interpretation of Gaussian processes (GPs) by constructing a particle approximation of the posterior of its hyperparameters using adaptive Markov chain Monte Carlo (MCMC) to increase the methods robustness. Also, our approach quantifies the epistemic uncertainty on the location of the optimum and the optimal value as induced by the limited number of objective evaluations used in obtaining it. We verify and validate our approach by solving two synthetic optimization problems under uncertainty and demonstrate it by solving the oil-well placement problem (OWPP) with uncertainties in the permeability field and the oil price time series.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Pandita, P., Bilionis, I., & Panchal, J. H. (2016). Extending Expected Improvement for High-Dimensional Stochastic Optimization of Expensive Black-Box Functions. Journal of Mechanical Design, 138(11). https://doi.org/10.1115/1.4034104

MLA 9

Pandita, Piyush, et al. “Extending Expected Improvement for High-Dimensional Stochastic Optimization of Expensive Black-Box Functions.” Journal of Mechanical Design, vol. 138, no. 11, 2016. https://doi.org/10.1115/1.4034104.

Chicago

Pandita, Piyush, Ilias Bilionis, and Jitesh H. Panchal. 2016. “Extending Expected Improvement for High-Dimensional Stochastic Optimization of Expensive Black-Box Functions.” Journal of Mechanical Design 138 (11). https://doi.org/10.1115/1.4034104.

Harvard

Pandita, P., Bilionis, I. and Panchal, J. H. (2016) ‘Extending Expected Improvement for High-Dimensional Stochastic Optimization of Expensive Black-Box Functions’, Journal of Mechanical Design, 138(11). doi:10.1115/1.4034104.

IEEE

P. Pandita, I. Bilionis, and J. H. Panchal, “Extending Expected Improvement for High-Dimensional Stochastic Optimization of Expensive Black-Box Functions,” Journal of Mechanical Design, vol. 138, no. 11, 2016, doi: 10.1115/1.4034104.

BibTeX

@article{pandita2016extending,
  title     = {{Extending Expected Improvement for High-Dimensional Stochastic Optimization of Expensive Black-Box Functions}},
  author    = {Pandita, Piyush and Bilionis, Ilias and Panchal, Jitesh H.},
  journal   = {Journal of Mechanical Design},
  year      = {2016},
  volume    = {138},
  number    = {11},
  doi       = {10.1115/1.4034104},
  url       = {https://doi.org/10.1115/1.4034104}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
201511
201822
201944
202155
202211
202311
202411
202622

Its field-weighted citation impact is 1.47: it has been cited 1.47 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Physical Sciences › Computer Science › Computational Theory and Mathematics › Advanced Multi-Objective Optimization Algorithms

  • expected improvement
  • expensive black-box functions
  • high-dimensional optimization
  • particle approximation
  • adaptive Markov chain Monte Carlo
  • epistemic uncertainty
  • design under uncertainty
  • oil price uncertainty

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Pandita, P., Bilionis, I., & Panchal, J. H. (2016). Extending Expected Improvement for High-Dimensional Stochastic Optimization of Expensive Black-Box Functions. Journal of Mechanical Design, 138(11). https://doi.org/10.1115/1.4034104

How many times has this paper been cited?

17 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

Piyush Pandita, Ilias Bilionis, Jitesh H. Panchal.

What is the DOI of this paper?

10.1115/1.4034104, permanently at https://doi.org/10.1115/1.4034104. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.