Paper · 2020 · Open access

What do you Mean? The Role of the Mean Function in Bayesian Optimisation

George De Ath, Jonathan Edward Fieldsend, Richard Everson

Open Research Exeter (University of Exeter) · Published 17 April 2020 · DOI 10.48550/arxiv.2004.08349

Open PDFView at the publisherCite this paper

In brief

“What do you Mean? The Role of the Mean Function in Bayesian Optimisation” is a 2020 paper by George De Ath and 2 co-authors, published in Open Research Exeter (University of Exeter). OpenAlex counts 7 citations as of 19 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).

Citations
7
Most cited in
2021 (2)
Field-weighted impact
1.56
References
45
Authors
3

Abstract

Bayesian optimisation is a popular approach for optimising expensive black-box functions. The next location to be evaluated is selected via maximising an acquisition function that balances exploitation and exploration. Gaussian processes, the surrogate models of choice in Bayesian optimisation, are often used with a constant prior mean function equal to the arithmetic mean of the observed function values. We show that the rate of convergence can depend sensitively on the choice of mean function. We empirically investigate 8 mean functions (constant functions equal to the arithmetic mean, minimum, median and maximum of the observed function evaluations, linear, quadratic polynomials, random forests and RBF networks), using 10 synthetic test problems and two real-world problems, and using the Expected Improvement and Upper Confidence Bound acquisition functions. We find that for design dimensions $\ge5$ using a constant mean function equal to the worst observed quality value is consistently the best choice on the synthetic problems considered. We argue that this worst-observed-quality function promotes exploitation leading to more rapid convergence. However, for the real-world tasks the more complex mean functions capable of modelling the fitness landscape may be effective, although there is no clearly optimum choice.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

De Ath, G., Fieldsend, J. E., & Everson, R. (2020). What do you Mean? The Role of the Mean Function in Bayesian Optimisation. Open Research Exeter (University of Exeter). https://doi.org/10.48550/arxiv.2004.08349

MLA 9

De Ath, George, et al. “What do you Mean? The Role of the Mean Function in Bayesian Optimisation.” Open Research Exeter (University of Exeter), 2020. https://doi.org/10.48550/arxiv.2004.08349.

Chicago

De Ath, George, Jonathan Edward Fieldsend, and Richard Everson. 2020. “What do you Mean? The Role of the Mean Function in Bayesian Optimisation.” Open Research Exeter (University of Exeter). https://doi.org/10.48550/arxiv.2004.08349.

Harvard

De Ath, G., Fieldsend, J. E. and Everson, R. (2020) ‘What do you Mean? The Role of the Mean Function in Bayesian Optimisation’, Open Research Exeter (University of Exeter). doi:10.48550/arxiv.2004.08349.

IEEE

G. De Ath, J. E. Fieldsend, and R. Everson, “What do you Mean? The Role of the Mean Function in Bayesian Optimisation,” Open Research Exeter (University of Exeter), 2020, doi: 10.48550/arxiv.2004.08349.

BibTeX

@article{death2020what,
  title     = {{What do you Mean? The Role of the Mean Function in Bayesian Optimisation}},
  author    = {De Ath, George and Fieldsend, Jonathan Edward and Everson, Richard},
  journal   = {Open Research Exeter (University of Exeter)},
  year      = {2020},
  doi       = {10.48550/arxiv.2004.08349},
  url       = {https://doi.org/10.48550/arxiv.2004.08349}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202122
202211
202322
202411
202511

Its field-weighted citation impact is 1.56: it has been cited 1.56 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research

  • Bayesian optimization
  • mean function
  • Kriging surrogate model
  • acquisition functions
  • expected improvement
  • upper confidence bound
  • black-box optimization
  • convergence rate

Work with this paper

Most-cited papers in Decision Sciences

All highly cited Decision Sciences papers

Questions about this paper

How do I cite this paper in APA style?

De Ath, G., Fieldsend, J. E., & Everson, R. (2020). What do you Mean? The Role of the Mean Function in Bayesian Optimisation. Open Research Exeter (University of Exeter). https://doi.org/10.48550/arxiv.2004.08349

How many times has this paper been cited?

7 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

George De Ath, Jonathan Edward Fieldsend, Richard Everson.

What is the DOI of this paper?

10.48550/arxiv.2004.08349, permanently at https://doi.org/10.48550/arxiv.2004.08349. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.