Journal article · 2025 · Open access

The potential existential threat of large language models to online survey research

Sean Jeremy Westwood

Proceedings of the National Academy of Sciences, 122(47), e2518075122 · Published 20 November 2025 · DOI 10.1073/pnas.2518075122

Open PDFView at the publisherCite this paper

In brief

“The potential existential threat of large language models to online survey research” is a 2025 journal article by Sean Jeremy Westwood, published in Proceedings of the National Academy of Sciences. OpenAlex counts 154 citations as of 17 November 2026. It is open access under a CC BY-NC-ND licence: the full text is free to read at Proceedings of the National Academy of Sciences.

Citations
154
Most cited in
2026 (141)
Field-weighted impact
107.21
References
22
Authors
1

Abstract

The advancement of large language models poses a severe, potentially existential threat to online survey research, a fundamental tool for data collection across the sciences. This work demonstrates that the foundational assumption of survey research-that a coherent response is a human response-is no longer tenable. I designed and tested an autonomous synthetic respondent capable of producing survey data that possesses the coherence and plausibility of human responses. This agent successfully evades a comprehensive suite of data quality checks, including instruction-following tasks, logic puzzles, and "reverse shibboleth" questions designed to detect nonhuman actors, achieving a 99.8% pass rate on 6,000 trials of standard attention checks. The synthetic respondent generates internally consistent responses by maintaining a coherent demographic persona and a memory of its prior answers, producing plausible data on psychometric scales, vignette comprehension tasks, and complex socioeconomic trade-offs. Furthermore, its open-ended text responses are linguistically sophisticated and stylistically calibrated to the level of education of its assigned persona. Critically, the agent can be instructed to maliciously alter polling outcomes, demonstrating an overt vector for information warfare. More subtly, it can also infer a researcher's latent hypotheses and produce data that artificially confirms them. These findings reveal a critical vulnerability in our data infrastructure, rendering most current detection methods obsolete and posing a potential existential threat to unsupervised online research. The scientific community must urgently develop new data validation standards and reconsider its reliance on nonprobability, low-barrier online data collection methods.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Westwood, S. J. (2025). The potential existential threat of large language models to online survey research. Proceedings of the National Academy of Sciences, 122(47), e2518075122. https://doi.org/10.1073/pnas.2518075122

MLA 9

Westwood, Sean Jeremy. “The potential existential threat of large language models to online survey research.” Proceedings of the National Academy of Sciences, vol. 122, no. 47, 2025, p. e2518075122. https://doi.org/10.1073/pnas.2518075122.

Chicago

Westwood, Sean Jeremy. 2025. “The potential existential threat of large language models to online survey research.” Proceedings of the National Academy of Sciences 122 (47): e2518075122. https://doi.org/10.1073/pnas.2518075122.

Harvard

Westwood, S. J. (2025) ‘The potential existential threat of large language models to online survey research’, Proceedings of the National Academy of Sciences, 122(47), p. e2518075122. doi:10.1073/pnas.2518075122.

IEEE

S. J. Westwood, “The potential existential threat of large language models to online survey research,” Proceedings of the National Academy of Sciences, vol. 122, no. 47, p. e2518075122, 2025, doi: 10.1073/pnas.2518075122.

BibTeX

@article{westwood2025potential,
  title     = {{The potential existential threat of large language models to online survey research}},
  author    = {Westwood, Sean Jeremy},
  journal   = {Proceedings of the National Academy of Sciences},
  year      = {2025},
  volume    = {122},
  number    = {47},
  pages     = {e2518075122},
  doi       = {10.1073/pnas.2518075122},
  url       = {https://doi.org/10.1073/pnas.2518075122}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
201611
202311
202411
20251010
2026141141

Its field-weighted citation impact is 107.21: it has been cited 107.21 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Social Sciences › Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse

  • large language models
  • online survey research
  • attention checks
  • data quality
  • data validation
  • information warfare

Work with this paper

Most-cited papers in Social Sciences

All highly cited Social Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Westwood, S. J. (2025). The potential existential threat of large language models to online survey research. Proceedings of the National Academy of Sciences, 122(47), e2518075122. https://doi.org/10.1073/pnas.2518075122

How many times has this paper been cited?

154 times, according to OpenAlex on 17 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at Proceedings of the National Academy of Sciences: sign in and open the PDF from this page.

Who wrote this paper?

Sean Jeremy Westwood.

What is the DOI of this paper?

10.1073/pnas.2518075122, permanently at https://doi.org/10.1073/pnas.2518075122. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 17 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.