Journal article · 2024 · Open access
An uncertainty-based objective function for hyperparameter optimization in Gaussian processes applied to expensive black-box problems
Applied Soft Computing, 154, 111325 · Published 1 February 2024 · DOI 10.1016/j.asoc.2024.111325
In brief
“An uncertainty-based objective function for hyperparameter optimization in Gaussian processes applied to expensive black-box problems” is a 2024 journal article by Pietro Lualdi and 3 co-authors, published in Applied Soft Computing. OpenAlex counts 19 citations as of 19 November 2026, which puts it in the top 4% of works published in 2024 by citations. It is open access under a CC BY licence: the full text is free to read at Applied Soft Computing.
- Citations
- 19
- Most cited in
- 2026 (15)
- Field-weighted impact
- 1.57
- References
- 70
- Authors
- 4
Abstract
As of today, Gaussian processes (GPs) have been widely and successfully used in the context of design optimization based on expensive-to-evaluate functions. This supervised learning method enables a generation of accurate nonlinear surrogate models based on relatively small datasets. Nonetheless, their most valuable asset is to provide uncertainty in predictions. Despite their excellent stochastic properties, Gaussian processes are unfortunately not immune to threats such as the generation of distorted predictions, especially when the amount of data available is very limited. This shortcoming is caused by a poor choice of the GP hyperparameters and represents a serious threat to the efficiency and effectiveness of the whole surrogate-based optimization. In this paper we present the Hybrid Loss (HL), a novel uncertainty-aware objective function for the hyperparameter tuning of Gaussian processes. This method is intended to exploit information coming from the predictive variance to remedy the typical shortcomings of the log marginal likelihood, i.e. the objective function commonly used to optimize GP hyperparameters. By pairing this methodology with a well-known adaptive sampling strategy, we investigate the performance on a wide range of benchmark functions and a real engineering problem. The observed evidence clearly shows how uncertainty can be successfully exploited to make a wiser choice of the hyperparameters. This translates into more accurate predictions, surrogate models less prone to overfitting, and above all, greatly improved convergence rates.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Lualdi, P., Sturm, R., Camero, A., & Siefkes, T. (2024). An uncertainty-based objective function for hyperparameter optimization in Gaussian processes applied to expensive black-box problems. Applied Soft Computing, 154, 111325. https://doi.org/10.1016/j.asoc.2024.111325
MLA 9
Lualdi, Pietro, et al. “An uncertainty-based objective function for hyperparameter optimization in Gaussian processes applied to expensive black-box problems.” Applied Soft Computing, vol. 154, 2024, p. 111325. https://doi.org/10.1016/j.asoc.2024.111325.
Chicago
Lualdi, Pietro, Ralf Sturm, Andrés Camero, and Tjark Siefkes. 2024. “An uncertainty-based objective function for hyperparameter optimization in Gaussian processes applied to expensive black-box problems.” Applied Soft Computing 154: 111325. https://doi.org/10.1016/j.asoc.2024.111325.
Harvard
Lualdi, P. et al. (2024) ‘An uncertainty-based objective function for hyperparameter optimization in Gaussian processes applied to expensive black-box problems’, Applied Soft Computing, 154, p. 111325. doi:10.1016/j.asoc.2024.111325.
IEEE
P. Lualdi, R. Sturm, A. Camero, and T. Siefkes, “An uncertainty-based objective function for hyperparameter optimization in Gaussian processes applied to expensive black-box problems,” Applied Soft Computing, vol. 154, p. 111325, 2024, doi: 10.1016/j.asoc.2024.111325.
BibTeX
@article{lualdi2024uncertainty,
title = {{An uncertainty-based objective function for hyperparameter optimization in Gaussian processes applied to expensive black-box problems}},
author = {Lualdi, Pietro and Sturm, Ralf and Camero, Andrés and Siefkes, Tjark},
journal = {Applied Soft Computing},
year = {2024},
volume = {154},
pages = {111325},
doi = {10.1016/j.asoc.2024.111325},
url = {https://doi.org/10.1016/j.asoc.2024.111325}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Gaussian Processes and Bayesian Inference
- Gaussian processes
- hyperparameter optimization
- hybrid loss
- predictive variance
- log marginal likelihood
- expensive black-box optimization
- surrogate-based optimization
- adaptive sampling
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Lualdi, P., Sturm, R., Camero, A., & Siefkes, T. (2024). An uncertainty-based objective function for hyperparameter optimization in Gaussian processes applied to expensive black-box problems. Applied Soft Computing, 154, 111325. https://doi.org/10.1016/j.asoc.2024.111325
How many times has this paper been cited?
19 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at Applied Soft Computing: sign in and open the full text from this page.
Who wrote this paper?
Pietro Lualdi, Ralf Sturm, Andrés Camero, Tjark Siefkes.
What is the DOI of this paper?
10.1016/j.asoc.2024.111325, permanently at https://doi.org/10.1016/j.asoc.2024.111325. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.