Journal article · 2026 · Open access
Many AI analysts, one dataset: Navigating the agentic data science multiverse
Proceedings of the National Academy of Sciences, 123(29), e2606495123 · Published 14 July 2026 · DOI 10.1073/pnas.2606495123
In brief
“Many AI analysts, one dataset: Navigating the agentic data science multiverse” is a 2026 journal article by Martín Bertrán and 2 co-authors, published in Proceedings of the National Academy of Sciences. OpenAlex counts 16 citations as of 18 November 2026, which puts it in the top 2% of works published in 2026 by citations. It is open access under a CC BY-NC-ND licence: the full text is free to read at Proceedings of the National Academy of Sciences.
- Citations
- 16
- Most cited in
- 2026 (16)
- Field-weighted impact
- 48.84
- References
- 58
- Authors
- 3
Abstract
Empirical conclusions depend not only on data but also on analytic decisions. Many-analyst studies have quantified this dependence: independent teams testing the same hypothesis on the same dataset regularly reach conflicting conclusions. But such studies require costly human coordination. We show that fully autonomous AI analysts built on large language models (LLMs) can, cheaply and at scale, produce the analytic dispersion observed in human many-analyst studies. In our framework, each AI analyst independently executes a complete analysis pipeline on a fixed dataset and hypothesis; a separate AI auditor screens every run for methodological validity. Across three datasets, AI analyst-produced analyses exhibit substantial dispersion in effect sizes, [Formula: see text]-values, and conclusions. This dispersion can be traced to identifiable analytic choices in preprocessing, model specification, and inference that vary systematically across LLM and persona conditions. Critically, the outcomes are steerable: reassigning the analyst persona or LLM shifts the distribution of results even among methodologically sound runs. These results highlight a central challenge for AI-automated empirical science: when defensible analyses are cheap to generate, evidence becomes abundant and vulnerable to selective reporting. The same capability also helps address it: treating analyst results as distributions makes analytic uncertainty visible, and deploying AI analysts against a published specification can reveal how much disagreement stems from underspecified design choices. Taken together, our results motivate a transparency norm: AI-generated analyses should be accompanied by multiverse-style reporting and full disclosure of the prompts used, on par with code and data.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Bertrán, M., Fogliato, R., & Wu, Z. S. (2026). Many AI analysts, one dataset: Navigating the agentic data science multiverse. Proceedings of the National Academy of Sciences, 123(29), e2606495123. https://doi.org/10.1073/pnas.2606495123
MLA 9
Bertrán, Martín, et al. “Many AI analysts, one dataset: Navigating the agentic data science multiverse.” Proceedings of the National Academy of Sciences, vol. 123, no. 29, 2026, p. e2606495123. https://doi.org/10.1073/pnas.2606495123.
Chicago
Bertrán, Martín, Riccardo Fogliato, and Zhiwei Steven Wu. 2026. “Many AI analysts, one dataset: Navigating the agentic data science multiverse.” Proceedings of the National Academy of Sciences 123 (29): e2606495123. https://doi.org/10.1073/pnas.2606495123.
Harvard
Bertrán, M., Fogliato, R. and Wu, Z. S. (2026) ‘Many AI analysts, one dataset: Navigating the agentic data science multiverse’, Proceedings of the National Academy of Sciences, 123(29), p. e2606495123. doi:10.1073/pnas.2606495123.
IEEE
M. Bertrán, R. Fogliato, and Z. S. Wu, “Many AI analysts, one dataset: Navigating the agentic data science multiverse,” Proceedings of the National Academy of Sciences, vol. 123, no. 29, p. e2606495123, 2026, doi: 10.1073/pnas.2606495123.
BibTeX
@article{bertran2026many,
title = {{Many AI analysts, one dataset: Navigating the agentic data science multiverse}},
author = {Bertrán, Martín and Fogliato, Riccardo and Wu, Zhiwei Steven},
journal = {Proceedings of the National Academy of Sciences},
year = {2026},
volume = {123},
number = {29},
pages = {e2606495123},
doi = {10.1073/pnas.2606495123},
url = {https://doi.org/10.1073/pnas.2606495123}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Social Sciences › Social Sciences › General Social Sciences › Computational and Text Analysis Methods
- large language models
- selective reporting
- effect size heterogeneity
Work with this paper
Most-cited papers in Social Sciences
- Using thematic analysis in psychologyVirginia Braun, Victoria Clarke · Qualitative Research in Psychology · 2006 · 240,222 citations
- Case Study Research: Design and MethodsRobert K. Yin · 1984 · 81,951 citations
- Three Approaches to Qualitative Content AnalysisHsiu-Fang Hsieh, Sarah Elizabeth Shannon · Qualitative Health Research · 2005 · 49,623 citations
- Qualitative Data Analysis: An Expanded SourcebookMatthew B. Miles, A Michael Huberman · Journal of Environmental Psychology · 1994 · 48,311 citations
- Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groupsAllison Tong, Peter Sainsbury, Jonathan C. Craig · International Journal for Quality in Health Care · 2007 · 45,353 citations
Questions about this paper
How do I cite this paper in APA style?
Bertrán, M., Fogliato, R., & Wu, Z. S. (2026). Many AI analysts, one dataset: Navigating the agentic data science multiverse. Proceedings of the National Academy of Sciences, 123(29), e2606495123. https://doi.org/10.1073/pnas.2606495123
How many times has this paper been cited?
16 times, according to OpenAlex on 18 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at Proceedings of the National Academy of Sciences: sign in and open the full text from this page.
Who wrote this paper?
Martín Bertrán, Riccardo Fogliato, Zhiwei Steven Wu.
What is the DOI of this paper?
10.1073/pnas.2606495123, permanently at https://doi.org/10.1073/pnas.2606495123. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 18 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.