Journal article · 2025 · Open access
The potential existential threat of large language models to online survey research
Proceedings of the National Academy of Sciences, 122(47), e2518075122 · Published 20 November 2025 · DOI 10.1073/pnas.2518075122
In brief
“The potential existential threat of large language models to online survey research” is a 2025 journal article by Sean Jeremy Westwood, published in Proceedings of the National Academy of Sciences. OpenAlex counts 154 citations as of 17 November 2026. It is open access under a CC BY-NC-ND licence: the full text is free to read at Proceedings of the National Academy of Sciences.
- Citations
- 154
- Most cited in
- 2026 (141)
- Field-weighted impact
- 107.21
- References
- 22
- Authors
- 1
Abstract
The advancement of large language models poses a severe, potentially existential threat to online survey research, a fundamental tool for data collection across the sciences. This work demonstrates that the foundational assumption of survey research-that a coherent response is a human response-is no longer tenable. I designed and tested an autonomous synthetic respondent capable of producing survey data that possesses the coherence and plausibility of human responses. This agent successfully evades a comprehensive suite of data quality checks, including instruction-following tasks, logic puzzles, and "reverse shibboleth" questions designed to detect nonhuman actors, achieving a 99.8% pass rate on 6,000 trials of standard attention checks. The synthetic respondent generates internally consistent responses by maintaining a coherent demographic persona and a memory of its prior answers, producing plausible data on psychometric scales, vignette comprehension tasks, and complex socioeconomic trade-offs. Furthermore, its open-ended text responses are linguistically sophisticated and stylistically calibrated to the level of education of its assigned persona. Critically, the agent can be instructed to maliciously alter polling outcomes, demonstrating an overt vector for information warfare. More subtly, it can also infer a researcher's latent hypotheses and produce data that artificially confirms them. These findings reveal a critical vulnerability in our data infrastructure, rendering most current detection methods obsolete and posing a potential existential threat to unsupervised online research. The scientific community must urgently develop new data validation standards and reconsider its reliance on nonprobability, low-barrier online data collection methods.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Westwood, S. J. (2025). The potential existential threat of large language models to online survey research. Proceedings of the National Academy of Sciences, 122(47), e2518075122. https://doi.org/10.1073/pnas.2518075122
MLA 9
Westwood, Sean Jeremy. “The potential existential threat of large language models to online survey research.” Proceedings of the National Academy of Sciences, vol. 122, no. 47, 2025, p. e2518075122. https://doi.org/10.1073/pnas.2518075122.
Chicago
Westwood, Sean Jeremy. 2025. “The potential existential threat of large language models to online survey research.” Proceedings of the National Academy of Sciences 122 (47): e2518075122. https://doi.org/10.1073/pnas.2518075122.
Harvard
Westwood, S. J. (2025) ‘The potential existential threat of large language models to online survey research’, Proceedings of the National Academy of Sciences, 122(47), p. e2518075122. doi:10.1073/pnas.2518075122.
IEEE
S. J. Westwood, “The potential existential threat of large language models to online survey research,” Proceedings of the National Academy of Sciences, vol. 122, no. 47, p. e2518075122, 2025, doi: 10.1073/pnas.2518075122.
BibTeX
@article{westwood2025potential,
title = {{The potential existential threat of large language models to online survey research}},
author = {Westwood, Sean Jeremy},
journal = {Proceedings of the National Academy of Sciences},
year = {2025},
volume = {122},
number = {47},
pages = {e2518075122},
doi = {10.1073/pnas.2518075122},
url = {https://doi.org/10.1073/pnas.2518075122}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2016 | 1 | |
| 2023 | 1 | |
| 2024 | 1 | |
| 2025 | 10 | |
| 2026 | 141 |
Its field-weighted citation impact is 107.21: it has been cited 107.21 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Social Sciences › Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- large language models
- online survey research
- attention checks
- data quality
- data validation
- information warfare
Work with this paper
Most-cited papers in Social Sciences
- Using thematic analysis in psychologyVirginia Braun, Victoria Clarke · Qualitative Research in Psychology · 2006 · 240,222 citations
- Case Study Research: Design and MethodsRobert K. Yin · 1984 · 81,951 citations
- Three Approaches to Qualitative Content AnalysisHsiu-Fang Hsieh, Sarah Elizabeth Shannon · Qualitative Health Research · 2005 · 49,623 citations
- Qualitative Data Analysis: An Expanded SourcebookMatthew B. Miles, A Michael Huberman · Journal of Environmental Psychology · 1994 · 48,311 citations
- Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groupsAllison Tong, Peter Sainsbury, Jonathan C. Craig · International Journal for Quality in Health Care · 2007 · 45,353 citations
Questions about this paper
How do I cite this paper in APA style?
Westwood, S. J. (2025). The potential existential threat of large language models to online survey research. Proceedings of the National Academy of Sciences, 122(47), e2518075122. https://doi.org/10.1073/pnas.2518075122
How many times has this paper been cited?
154 times, according to OpenAlex on 17 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at Proceedings of the National Academy of Sciences: sign in and open the PDF from this page.
Who wrote this paper?
Sean Jeremy Westwood.
What is the DOI of this paper?
10.1073/pnas.2518075122, permanently at https://doi.org/10.1073/pnas.2518075122. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 17 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.