Dissertation · 2018 · Open access

On Bayesian optimization and its application to hyperparameter tuning

Antonio Matosevic

DiVA (Digitala Vetenskapliga Arkivet) · Published 1 January 2018

Open full textCite this paper

In brief

“On Bayesian optimization and its application to hyperparameter tuning” is a 2018 dissertation by Antonio Matosevic, published in DiVA (Digitala Vetenskapliga Arkivet). OpenAlex counts 2 citations as of 19 November 2026. It is open access: the full text is free to read at DiVA (Digitala Vetenskapliga Arkivet).

Citations
2
Most cited in
2023 (1)
Authors
1

Abstract

This thesis introduces the concept of Bayesian optimization, primarly used in optimizing costly black-box functions. Besides theoretical treatment of the topic, the focus of the thesis is on two numerical experiments. Firstly, different types of acquisition functions, which are the key components responsible for the performance, are tested and compared. Special emphasis is on the analysis of a so-called exploration-exploitation trade-off. Secondly, one of the most recent applications of Bayesian optimization concerns hyperparameter tuning in machine learning algorithms, where the objective function is expensive to evaluate and not given analytically. However, some results indicate that much simpler methods can give similar results. Our contribution is therefore a statistical comparison of simple random search and Bayesian optimization in the context of finding the optimal set of hyperparameters in support vector regression. It has been found that there is no significant difference in performance of these two methods.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Matosevic, A. (2018). On Bayesian optimization and its application to hyperparameter tuning. DiVA (Digitala Vetenskapliga Arkivet). http://urn.kb.se/resolve?urn=urn:nbn:se:lnu:diva-74962

MLA 9

Matosevic, Antonio. “On Bayesian optimization and its application to hyperparameter tuning.” DiVA (Digitala Vetenskapliga Arkivet), 2018. http://urn.kb.se/resolve?urn=urn:nbn:se:lnu:diva-74962.

Chicago

Matosevic, Antonio. 2018. “On Bayesian optimization and its application to hyperparameter tuning.” DiVA (Digitala Vetenskapliga Arkivet). http://urn.kb.se/resolve?urn=urn:nbn:se:lnu:diva-74962.

Harvard

Matosevic, A. (2018) ‘On Bayesian optimization and its application to hyperparameter tuning’, DiVA (Digitala Vetenskapliga Arkivet). Available at: http://urn.kb.se/resolve?urn=urn:nbn:se:lnu:diva-74962.

IEEE

A. Matosevic, “On Bayesian optimization and its application to hyperparameter tuning,” DiVA (Digitala Vetenskapliga Arkivet), 2018.

BibTeX

@phdthesis{matosevic2018bayesian,
  title     = {{On Bayesian optimization and its application to hyperparameter tuning}},
  author    = {Matosevic, Antonio},
  year      = {2018},
  url       = {http://urn.kb.se/resolve?urn=urn:nbn:se:lnu:diva-74962}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research

  • Bayesian optimization
  • hyperparameter optimization
  • acquisition functions
  • exploration-exploitation balance
  • black-box optimization
  • random search
  • support vector regression
  • expensive objective functions

Work with this paper

Most-cited papers in Decision Sciences

All highly cited Decision Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Matosevic, A. (2018). On Bayesian optimization and its application to hyperparameter tuning. DiVA (Digitala Vetenskapliga Arkivet). http://urn.kb.se/resolve?urn=urn:nbn:se:lnu:diva-74962

How many times has this paper been cited?

2 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at DiVA (Digitala Vetenskapliga Arkivet): sign in and open the full text from this page.

Who wrote this paper?

Antonio Matosevic.

Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.