Journal article · 2025 · Open access

Alpha entropy search for new information-based Bayesian optimization

Daniel Fernández-Sánchez, Eduardo C. Garrido‐Merchán, Daniel Hernández-Lobato

Knowledge-Based Systems, 322, 113612 · Published 16 May 2025 · DOI 10.1016/j.knosys.2025.113612

Open full textCite this paper

In brief

“Alpha entropy search for new information-based Bayesian optimization” is a 2025 journal article by Daniel Fernández-Sánchez and 2 co-authors, published in Knowledge-Based Systems. OpenAlex counts 4 citations as of 19 November 2026. It is open access under a CC BY-NC-ND licence: the full text is free to read at Knowledge-Based Systems.

Citations
4
Most cited in
2025 (3)
Field-weighted impact
1.59
References
43
Authors
3

Abstract

Bayesian optimization (BO) methods based on information theory have obtained state-of-the-art results in several tasks. These techniques rely on the Kullback–Leibler (KL) divergence to compute the acquisition function. We introduce a novel information-based class of acquisition functions for BO called Alpha Entropy Search (AES). AES is based on the alpha-divergence, which generalizes the KL-divergence. Iteratively, AES selects the next evaluation point as the one whose associated target value has the highest level of dependency with respect to the location and associated value of the global maximum of the optimization problem. Dependency is measured in terms of the alpha-divergence, as an alternative to the KL-divergence. Intuitively, this favors evaluating the objective function at the most informative points about the global maximum. The alpha-divergence has a free parameter α , which determines the behavior of the divergence, balancing local and global differences. Therefore, different values of α result in different acquisition functions. AES acquisition lacks a closed-form expression. However, we propose an efficient and accurate approximation using a truncated Gaussian distribution. In practice, the value of α can be chosen by the practitioner, but here we suggest using a combination of acquisition functions obtained by simultaneously considering a range of α values. We provide an implementation of AES in BOTorch and we evaluate its performance in synthetic, benchmark, and real-world experiments involving the tuning of the hyper-parameters of a deep neural network. These experiments show that AES performance is competitive with other information-based acquisition functions such as JES, MES, or PES.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Fernández-Sánchez, D., Garrido‐Merchán, E. C., & Hernández-Lobato, D. (2025). Alpha entropy search for new information-based Bayesian optimization. Knowledge-Based Systems, 322, 113612. https://doi.org/10.1016/j.knosys.2025.113612

MLA 9

Fernández-Sánchez, Daniel, et al. “Alpha entropy search for new information-based Bayesian optimization.” Knowledge-Based Systems, vol. 322, 2025, p. 113612. https://doi.org/10.1016/j.knosys.2025.113612.

Chicago

Fernández-Sánchez, Daniel, Eduardo C. Garrido‐Merchán, and Daniel Hernández-Lobato. 2025. “Alpha entropy search for new information-based Bayesian optimization.” Knowledge-Based Systems 322: 113612. https://doi.org/10.1016/j.knosys.2025.113612.

Harvard

Fernández-Sánchez, D., Garrido‐Merchán, E. C. and Hernández-Lobato, D. (2025) ‘Alpha entropy search for new information-based Bayesian optimization’, Knowledge-Based Systems, 322, p. 113612. doi:10.1016/j.knosys.2025.113612.

IEEE

D. Fernández-Sánchez, E. C. Garrido‐Merchán, and D. Hernández-Lobato, “Alpha entropy search for new information-based Bayesian optimization,” Knowledge-Based Systems, vol. 322, p. 113612, 2025, doi: 10.1016/j.knosys.2025.113612.

BibTeX

@article{fernandezsanchez2025alpha,
  title     = {{Alpha entropy search for new information-based Bayesian optimization}},
  author    = {Fernández-Sánchez, Daniel and Garrido‐Merchán, Eduardo C. and Hernández-Lobato, Daniel},
  journal   = {Knowledge-Based Systems},
  year      = {2025},
  volume    = {322},
  pages     = {113612},
  doi       = {10.1016/j.knosys.2025.113612},
  url       = {https://doi.org/10.1016/j.knosys.2025.113612}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research

  • Bayesian optimization
  • alpha-divergence
  • acquisition functions
  • Kullback-Leibler divergence
  • hyperparameter optimization

Work with this paper

Most-cited papers in Decision Sciences

All highly cited Decision Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Fernández-Sánchez, D., Garrido‐Merchán, E. C., & Hernández-Lobato, D. (2025). Alpha entropy search for new information-based Bayesian optimization. Knowledge-Based Systems, 322, 113612. https://doi.org/10.1016/j.knosys.2025.113612

How many times has this paper been cited?

4 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at Knowledge-Based Systems: sign in and open the full text from this page.

Who wrote this paper?

Daniel Fernández-Sánchez, Eduardo C. Garrido‐Merchán, Daniel Hernández-Lobato.

What is the DOI of this paper?

10.1016/j.knosys.2025.113612, permanently at https://doi.org/10.1016/j.knosys.2025.113612. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.