Preprint · 2022 · Open access
Preference Exploration for Efficient Bayesian Optimization with Multiple Outcomes
arXiv (Cornell University) · Published 21 March 2022 · DOI 10.48550/arxiv.2203.11382
In brief
“Preference Exploration for Efficient Bayesian Optimization with Multiple Outcomes” is a 2022 preprint by Zhiyuan Jerry Lin and 3 co-authors, published in arXiv (Cornell University). OpenAlex counts 30 citations as of 19 November 2026. It is open access under a CC BY licence: the full text is free to read at arXiv (Cornell University).
- Citations
- 30
- Most cited in
- 2026 (10)
- References
- 33
- Authors
- 4
Abstract
We consider Bayesian optimization of expensive-to-evaluate experiments that generate vector-valued outcomes over which a decision-maker (DM) has preferences. These preferences are encoded by a utility function that is not known in closed form but can be estimated by asking the DM to express preferences over pairs of outcome vectors. To address this problem, we develop Bayesian optimization with preference exploration, a novel framework that alternates between interactive real-time preference learning with the DM via pairwise comparisons between outcomes, and Bayesian optimization with a learned compositional model of DM utility and outcomes. Within this framework, we propose preference exploration strategies specifically designed for this task, and demonstrate their performance via extensive simulation studies.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Lin, Z. J., Astudillo, R., Frazier, P. I., & Bakshy, E. (2022). Preference Exploration for Efficient Bayesian Optimization with Multiple Outcomes. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2203.11382
MLA 9
Lin, Zhiyuan Jerry, et al. “Preference Exploration for Efficient Bayesian Optimization with Multiple Outcomes.” arXiv (Cornell University), 2022. https://doi.org/10.48550/arxiv.2203.11382.
Chicago
Lin, Zhiyuan Jerry, Raul Astudillo, Peter I. Frazier, and Eytan Bakshy. 2022. “Preference Exploration for Efficient Bayesian Optimization with Multiple Outcomes.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.2203.11382.
Harvard
Lin, Z. J. et al. (2022) ‘Preference Exploration for Efficient Bayesian Optimization with Multiple Outcomes’, arXiv (Cornell University). doi:10.48550/arxiv.2203.11382.
IEEE
Z. J. Lin, R. Astudillo, P. I. Frazier, and E. Bakshy, “Preference Exploration for Efficient Bayesian Optimization with Multiple Outcomes,” arXiv (Cornell University), 2022, doi: 10.48550/arxiv.2203.11382.
BibTeX
@misc{lin2022preference,
title = {{Preference Exploration for Efficient Bayesian Optimization with Multiple Outcomes}},
author = {Lin, Zhiyuan Jerry and Astudillo, Raul and Frazier, Peter I. and Bakshy, Eytan},
howpublished = {arXiv (Cornell University)},
year = {2022},
doi = {10.48550/arxiv.2203.11382},
url = {https://doi.org/10.48550/arxiv.2203.11382}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2022 | 2 | |
| 2023 | 6 | |
| 2024 | 4 | |
| 2025 | 8 | |
| 2026 | 10 |
Topic and keywords
Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
- Bayesian optimization
- multi-objective optimization
- pairwise comparison
- preference learning
- utility estimation
- interactive decision making
Work with this paper
Most-cited papers in Decision Sciences
- The PRISMA 2020 statement: an updated guideline for reporting systematic reviewsMatthew James Page, Joanne E. McKenzie, Patrick M. Bossuyt and 23 more · BMJ · 2021 · 144,919 citations
- Evaluating Structural Equation Models with Unobservable Variables and Measurement ErrorClaes Fornell, David F. Larcker · Journal of Marketing Research · 1981 · 118,336 citations
- Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternativesLi‐tze Hu, Peter M. Bentler · Structural Equation Modeling A Multidisciplinary Journal · 1999 · 117,461 citations
- Common method biases in behavioral research: A critical review of the literature and recommended remedies.Philip M. Podsakoff, SCOTT B. MACKENZIE, Jeong Yeon Lee and 1 more · Journal of Applied Psychology · 2003 · 89,248 citations
- Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statementDavid Moher, Alessandro Liberati, Jennifer Tetzlaff and 2 more · BMJ · 2009 · 85,524 citations
Questions about this paper
How do I cite this paper in APA style?
Lin, Z. J., Astudillo, R., Frazier, P. I., & Bakshy, E. (2022). Preference Exploration for Efficient Bayesian Optimization with Multiple Outcomes. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2203.11382
How many times has this paper been cited?
30 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.
Who wrote this paper?
Zhiyuan Jerry Lin, Raul Astudillo, Peter I. Frazier, Eytan Bakshy.
What is the DOI of this paper?
10.48550/arxiv.2203.11382, permanently at https://doi.org/10.48550/arxiv.2203.11382. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.