Journal article · 2025 · Open access
Alpha entropy search for new information-based Bayesian optimization
Knowledge-Based Systems, 322, 113612 · Published 16 May 2025 · DOI 10.1016/j.knosys.2025.113612
In brief
“Alpha entropy search for new information-based Bayesian optimization” is a 2025 journal article by Daniel Fernández-Sánchez and 2 co-authors, published in Knowledge-Based Systems. OpenAlex counts 4 citations as of 19 November 2026. It is open access under a CC BY-NC-ND licence: the full text is free to read at Knowledge-Based Systems.
- Citations
- 4
- Most cited in
- 2025 (3)
- Field-weighted impact
- 1.59
- References
- 43
- Authors
- 3
Abstract
Bayesian optimization (BO) methods based on information theory have obtained state-of-the-art results in several tasks. These techniques rely on the Kullback–Leibler (KL) divergence to compute the acquisition function. We introduce a novel information-based class of acquisition functions for BO called Alpha Entropy Search (AES). AES is based on the alpha-divergence, which generalizes the KL-divergence. Iteratively, AES selects the next evaluation point as the one whose associated target value has the highest level of dependency with respect to the location and associated value of the global maximum of the optimization problem. Dependency is measured in terms of the alpha-divergence, as an alternative to the KL-divergence. Intuitively, this favors evaluating the objective function at the most informative points about the global maximum. The alpha-divergence has a free parameter α , which determines the behavior of the divergence, balancing local and global differences. Therefore, different values of α result in different acquisition functions. AES acquisition lacks a closed-form expression. However, we propose an efficient and accurate approximation using a truncated Gaussian distribution. In practice, the value of α can be chosen by the practitioner, but here we suggest using a combination of acquisition functions obtained by simultaneously considering a range of α values. We provide an implementation of AES in BOTorch and we evaluate its performance in synthetic, benchmark, and real-world experiments involving the tuning of the hyper-parameters of a deep neural network. These experiments show that AES performance is competitive with other information-based acquisition functions such as JES, MES, or PES.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Fernández-Sánchez, D., Garrido‐Merchán, E. C., & Hernández-Lobato, D. (2025). Alpha entropy search for new information-based Bayesian optimization. Knowledge-Based Systems, 322, 113612. https://doi.org/10.1016/j.knosys.2025.113612
MLA 9
Fernández-Sánchez, Daniel, et al. “Alpha entropy search for new information-based Bayesian optimization.” Knowledge-Based Systems, vol. 322, 2025, p. 113612. https://doi.org/10.1016/j.knosys.2025.113612.
Chicago
Fernández-Sánchez, Daniel, Eduardo C. Garrido‐Merchán, and Daniel Hernández-Lobato. 2025. “Alpha entropy search for new information-based Bayesian optimization.” Knowledge-Based Systems 322: 113612. https://doi.org/10.1016/j.knosys.2025.113612.
Harvard
Fernández-Sánchez, D., Garrido‐Merchán, E. C. and Hernández-Lobato, D. (2025) ‘Alpha entropy search for new information-based Bayesian optimization’, Knowledge-Based Systems, 322, p. 113612. doi:10.1016/j.knosys.2025.113612.
IEEE
D. Fernández-Sánchez, E. C. Garrido‐Merchán, and D. Hernández-Lobato, “Alpha entropy search for new information-based Bayesian optimization,” Knowledge-Based Systems, vol. 322, p. 113612, 2025, doi: 10.1016/j.knosys.2025.113612.
BibTeX
@article{fernandezsanchez2025alpha,
title = {{Alpha entropy search for new information-based Bayesian optimization}},
author = {Fernández-Sánchez, Daniel and Garrido‐Merchán, Eduardo C. and Hernández-Lobato, Daniel},
journal = {Knowledge-Based Systems},
year = {2025},
volume = {322},
pages = {113612},
doi = {10.1016/j.knosys.2025.113612},
url = {https://doi.org/10.1016/j.knosys.2025.113612}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
- Bayesian optimization
- alpha-divergence
- acquisition functions
- Kullback-Leibler divergence
- hyperparameter optimization
Work with this paper
Most-cited papers in Decision Sciences
- The PRISMA 2020 statement: an updated guideline for reporting systematic reviewsMatthew James Page, Joanne E. McKenzie, Patrick M. Bossuyt and 23 more · BMJ · 2021 · 144,919 citations
- Evaluating Structural Equation Models with Unobservable Variables and Measurement ErrorClaes Fornell, David F. Larcker · Journal of Marketing Research · 1981 · 118,336 citations
- Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternativesLi‐tze Hu, Peter M. Bentler · Structural Equation Modeling A Multidisciplinary Journal · 1999 · 117,461 citations
- Common method biases in behavioral research: A critical review of the literature and recommended remedies.Philip M. Podsakoff, SCOTT B. MACKENZIE, Jeong Yeon Lee and 1 more · Journal of Applied Psychology · 2003 · 89,248 citations
- Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statementDavid Moher, Alessandro Liberati, Jennifer Tetzlaff and 2 more · BMJ · 2009 · 85,524 citations
Questions about this paper
How do I cite this paper in APA style?
Fernández-Sánchez, D., Garrido‐Merchán, E. C., & Hernández-Lobato, D. (2025). Alpha entropy search for new information-based Bayesian optimization. Knowledge-Based Systems, 322, 113612. https://doi.org/10.1016/j.knosys.2025.113612
How many times has this paper been cited?
4 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at Knowledge-Based Systems: sign in and open the full text from this page.
Who wrote this paper?
Daniel Fernández-Sánchez, Eduardo C. Garrido‐Merchán, Daniel Hernández-Lobato.
What is the DOI of this paper?
10.1016/j.knosys.2025.113612, permanently at https://doi.org/10.1016/j.knosys.2025.113612. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.