Conference paper · 2022 · Open access

Joint Entropy Search for Maximally-Informed Bayesian Optimization

Carl Hvarfner, Frank Hutter, Luigi Nardi

neural information processing systems, 11494–11506 · Published 1 January 2022 · DOI 10.52202/068431-0835

Open PDFView at the publisherCite this paper

In brief

“Joint Entropy Search for Maximally-Informed Bayesian Optimization” is a 2022 conference paper by Carl Hvarfner and 2 co-authors, published in neural information processing systems. OpenAlex counts 77 citations as of 19 November 2026, which puts it in the top 8% of works published in 2022 by citations. It is open access: the full text is free to read at arXiv (Cornell University).

Citations
77
Most cited in
2025 (25)
Field-weighted impact
15.19
References
31
Authors
3

Abstract

Information-theoretic Bayesian optimization techniques have become popular for optimizing expensive-to-evaluate black-box functions due to their non-myopic qualities. Entropy Search and Predictive Entropy Search both consider the entropy over the optimum in the input space, while the recent Max-value Entropy Search considers the entropy over the optimal value in the output space. We propose Joint Entropy Search (JES), a novel information-theoretic acquisition function that considers an entirely new quantity, namely the entropy over the joint optimal probability density over both input and output space. To incorporate this information, we consider the reduction in entropy from conditioning on fantasized optimal input/output pairs. The resulting approach primarily relies on standard GP machinery and removes complex approximations typically associated with information-theoretic methods. With minimal computational overhead, JES shows superior decision-making, and yields state-of-the-art performance for information-theoretic approaches across a wide suite of tasks. As a light-weight approach with superior results, JES provides a new go-to acquisition function for Bayesian optimization.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Hvarfner, C., Hutter, F., & Nardi, L. (2022). Joint Entropy Search for Maximally-Informed Bayesian Optimization. neural information processing systems, 11494–11506. https://doi.org/10.52202/068431-0835

MLA 9

Hvarfner, Carl, et al. “Joint Entropy Search for Maximally-Informed Bayesian Optimization.” neural information processing systems, 2022, pp. 11494–11506. https://doi.org/10.52202/068431-0835.

Chicago

Hvarfner, Carl, Frank Hutter, and Luigi Nardi. 2022. “Joint Entropy Search for Maximally-Informed Bayesian Optimization.” neural information processing systems: 11494–11506. https://doi.org/10.52202/068431-0835.

Harvard

Hvarfner, C., Hutter, F. and Nardi, L. (2022) ‘Joint Entropy Search for Maximally-Informed Bayesian Optimization’, neural information processing systems, pp. 11494–11506. doi:10.52202/068431-0835.

IEEE

C. Hvarfner, F. Hutter, and L. Nardi, “Joint Entropy Search for Maximally-Informed Bayesian Optimization,” neural information processing systems, pp. 11494–11506, 2022, doi: 10.52202/068431-0835.

BibTeX

@inproceedings{hvarfner2022joint,
  title     = {{Joint Entropy Search for Maximally-Informed Bayesian Optimization}},
  author    = {Hvarfner, Carl and Hutter, Frank and Nardi, Luigi},
  booktitle = {neural information processing systems},
  year      = {2022},
  pages     = {11494--11506},
  doi       = {10.52202/068431-0835},
  url       = {https://doi.org/10.52202/068431-0835}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202222
20231313
20241313
20252525
20262424

Its field-weighted citation impact is 15.19: it has been cited 15.19 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research

  • Bayesian optimization
  • black-box optimization
  • Kriging surrogate model
  • entropy reduction

Work with this paper

Most-cited papers in Decision Sciences

All highly cited Decision Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Hvarfner, C., Hutter, F., & Nardi, L. (2022). Joint Entropy Search for Maximally-Informed Bayesian Optimization. neural information processing systems, 11494–11506. https://doi.org/10.52202/068431-0835

How many times has this paper been cited?

77 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

Carl Hvarfner, Frank Hutter, Luigi Nardi.

What is the DOI of this paper?

10.52202/068431-0835, permanently at https://doi.org/10.52202/068431-0835. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.