Dissertation · 2018 · Open access
On Bayesian optimization and its application to hyperparameter tuning
DiVA (Digitala Vetenskapliga Arkivet) · Published 1 January 2018
In brief
“On Bayesian optimization and its application to hyperparameter tuning” is a 2018 dissertation by Antonio Matosevic, published in DiVA (Digitala Vetenskapliga Arkivet). OpenAlex counts 2 citations as of 19 November 2026. It is open access: the full text is free to read at DiVA (Digitala Vetenskapliga Arkivet).
- Citations
- 2
- Most cited in
- 2023 (1)
- Authors
- 1
Abstract
This thesis introduces the concept of Bayesian optimization, primarly used in optimizing costly black-box functions. Besides theoretical treatment of the topic, the focus of the thesis is on two numerical experiments. Firstly, different types of acquisition functions, which are the key components responsible for the performance, are tested and compared. Special emphasis is on the analysis of a so-called exploration-exploitation trade-off. Secondly, one of the most recent applications of Bayesian optimization concerns hyperparameter tuning in machine learning algorithms, where the objective function is expensive to evaluate and not given analytically. However, some results indicate that much simpler methods can give similar results. Our contribution is therefore a statistical comparison of simple random search and Bayesian optimization in the context of finding the optimal set of hyperparameters in support vector regression. It has been found that there is no significant difference in performance of these two methods.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Matosevic, A. (2018). On Bayesian optimization and its application to hyperparameter tuning. DiVA (Digitala Vetenskapliga Arkivet). http://urn.kb.se/resolve?urn=urn:nbn:se:lnu:diva-74962
MLA 9
Matosevic, Antonio. “On Bayesian optimization and its application to hyperparameter tuning.” DiVA (Digitala Vetenskapliga Arkivet), 2018. http://urn.kb.se/resolve?urn=urn:nbn:se:lnu:diva-74962.
Chicago
Matosevic, Antonio. 2018. “On Bayesian optimization and its application to hyperparameter tuning.” DiVA (Digitala Vetenskapliga Arkivet). http://urn.kb.se/resolve?urn=urn:nbn:se:lnu:diva-74962.
Harvard
Matosevic, A. (2018) ‘On Bayesian optimization and its application to hyperparameter tuning’, DiVA (Digitala Vetenskapliga Arkivet). Available at: http://urn.kb.se/resolve?urn=urn:nbn:se:lnu:diva-74962.
IEEE
A. Matosevic, “On Bayesian optimization and its application to hyperparameter tuning,” DiVA (Digitala Vetenskapliga Arkivet), 2018.
BibTeX
@phdthesis{matosevic2018bayesian,
title = {{On Bayesian optimization and its application to hyperparameter tuning}},
author = {Matosevic, Antonio},
year = {2018},
url = {http://urn.kb.se/resolve?urn=urn:nbn:se:lnu:diva-74962}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
- Bayesian optimization
- hyperparameter optimization
- acquisition functions
- exploration-exploitation balance
- black-box optimization
- random search
- support vector regression
- expensive objective functions
Work with this paper
Most-cited papers in Decision Sciences
- The PRISMA 2020 statement: an updated guideline for reporting systematic reviewsMatthew James Page, Joanne E. McKenzie, Patrick M. Bossuyt and 23 more · BMJ · 2021 · 144,919 citations
- Evaluating Structural Equation Models with Unobservable Variables and Measurement ErrorClaes Fornell, David F. Larcker · Journal of Marketing Research · 1981 · 118,336 citations
- Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternativesLi‐tze Hu, Peter M. Bentler · Structural Equation Modeling A Multidisciplinary Journal · 1999 · 117,461 citations
- Common method biases in behavioral research: A critical review of the literature and recommended remedies.Philip M. Podsakoff, SCOTT B. MACKENZIE, Jeong Yeon Lee and 1 more · Journal of Applied Psychology · 2003 · 89,248 citations
- Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statementDavid Moher, Alessandro Liberati, Jennifer Tetzlaff and 2 more · BMJ · 2009 · 85,524 citations
Questions about this paper
How do I cite this paper in APA style?
Matosevic, A. (2018). On Bayesian optimization and its application to hyperparameter tuning. DiVA (Digitala Vetenskapliga Arkivet). http://urn.kb.se/resolve?urn=urn:nbn:se:lnu:diva-74962
How many times has this paper been cited?
2 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at DiVA (Digitala Vetenskapliga Arkivet): sign in and open the full text from this page.
Who wrote this paper?
Antonio Matosevic.
Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.