Preprint · 2021 · Open access

Computationally Efficient High-Dimensional Bayesian Optimization via Variable Selection

Yihang Shen, Carl Kingsford

arXiv (Cornell University) · Published 20 September 2021 · DOI 10.48550/arxiv.2109.09264

Open PDFView at the publisherCite this paper

In brief

“Computationally Efficient High-Dimensional Bayesian Optimization via Variable Selection” is a 2021 preprint by Yihang Shen and Carl Kingsford, published in arXiv (Cornell University). OpenAlex counts 14 citations as of 19 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).

Citations
14
Most cited in
2025 (9)
References
41
Authors
2

Abstract

Bayesian Optimization (BO) is a method for globally optimizing black-box functions. While BO has been successfully applied to many scenarios, developing effective BO algorithms that scale to functions with high-dimensional domains is still a challenge. Optimizing such functions by vanilla BO is extremely time-consuming. Alternative strategies for high-dimensional BO that are based on the idea of embedding the high-dimensional space to the one with low dimension are sensitive to the choice of the embedding dimension, which needs to be pre-specified. We develop a new computationally efficient high-dimensional BO method that exploits variable selection. Our method is able to automatically learn axis-aligned sub-spaces, i.e. spaces containing selected variables, without the demand of any pre-specified hyperparameters. We theoretically analyze the computational complexity of our algorithm and derive the regret bound. We empirically show the efficacy of our method on several synthetic and real problems.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Shen, Y., & Kingsford, C. (2021). Computationally Efficient High-Dimensional Bayesian Optimization via Variable Selection. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2109.09264

MLA 9

Shen, Yihang, and Carl Kingsford. “Computationally Efficient High-Dimensional Bayesian Optimization via Variable Selection.” arXiv (Cornell University), 2021. https://doi.org/10.48550/arxiv.2109.09264.

Chicago

Shen, Yihang and Carl Kingsford. 2021. “Computationally Efficient High-Dimensional Bayesian Optimization via Variable Selection.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.2109.09264.

Harvard

Shen, Y. and Kingsford, C. (2021) ‘Computationally Efficient High-Dimensional Bayesian Optimization via Variable Selection’, arXiv (Cornell University). doi:10.48550/arxiv.2109.09264.

IEEE

Y. Shen and C. Kingsford, “Computationally Efficient High-Dimensional Bayesian Optimization via Variable Selection,” arXiv (Cornell University), 2021, doi: 10.48550/arxiv.2109.09264.

BibTeX

@misc{shen2021computationally,
  title     = {{Computationally Efficient High-Dimensional Bayesian Optimization via Variable Selection}},
  author    = {Shen, Yihang and Kingsford, Carl},
  howpublished = {arXiv (Cornell University)},
  year      = {2021},
  doi       = {10.48550/arxiv.2109.09264},
  url       = {https://doi.org/10.48550/arxiv.2109.09264}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202211
202322
202599
202622

Topic and keywords

Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research

  • Bayesian optimization
  • high-dimensional optimization
  • feature selection
  • black-box optimization
  • computational efficiency
  • regret bounds
  • complexity analysis

Work with this paper

Most-cited papers in Decision Sciences

All highly cited Decision Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Shen, Y., & Kingsford, C. (2021). Computationally Efficient High-Dimensional Bayesian Optimization via Variable Selection. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2109.09264

How many times has this paper been cited?

14 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

Yihang Shen, Carl Kingsford.

What is the DOI of this paper?

10.48550/arxiv.2109.09264, permanently at https://doi.org/10.48550/arxiv.2109.09264. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.