Preprint · 2025 · Open access

Synthetic respondents and the illusion of human data

Zhicheng Lin

PsyArXiv (OSF Preprints) · Published 24 November 2025 · DOI 10.31234/osf.io/6q9ps_v1

Open full textCite this paper

In brief

“Synthetic respondents and the illusion of human data” is a 2025 preprint by Zhicheng Lin, published in PsyArXiv (OSF Preprints). OpenAlex counts 0 citations as of 18 November 2026. It is open access under a CC BY licence: the full text is free to read at PsyArXiv (OSF Preprints).

Citations
0
Authors
1

Abstract

Online behavioral research assumes that coherent, internally consistent responses indicate useful human data. This assumption is now challenged by autonomous AI agents, which achieve 99.8% pass rates on attention checks while generating psychometrically sound, hypothesis-confirming data indistinguishable from careful human work. The contamination is already widespread—approximately one-third of survey participants report using AI assistance—and produces systematic bias that registers as signal rather than noise. Traditional detection methods fail because they target low-effort humans while AI produces high-effort patterns. Economic incentives are powerful, and the threat recursive: AI-mediated responses become training data for models that mediate future responses, creating feedback loops toward model-shaped consensus. The field requires contamination-aware statistical frameworks and stratified sampling by evidential role, treating online convenience samples as exploratory while demanding robust recruitment for confirmatory inference.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Lin, Z. (2025). Synthetic respondents and the illusion of human data. PsyArXiv (OSF Preprints). https://doi.org/10.31234/osf.io/6q9ps_v1

MLA 9

Lin, Zhicheng. “Synthetic respondents and the illusion of human data.” PsyArXiv (OSF Preprints), 2025. https://doi.org/10.31234/osf.io/6q9ps_v1.

Chicago

Lin, Zhicheng. 2025. “Synthetic respondents and the illusion of human data.” PsyArXiv (OSF Preprints). https://doi.org/10.31234/osf.io/6q9ps_v1.

Harvard

Lin, Z. (2025) ‘Synthetic respondents and the illusion of human data’, PsyArXiv (OSF Preprints). doi:10.31234/osf.io/6q9ps_v1.

IEEE

Z. Lin, “Synthetic respondents and the illusion of human data,” PsyArXiv (OSF Preprints), 2025, doi: 10.31234/osf.io/6q9ps_v1.

BibTeX

@misc{lin2025synthetic,
  title     = {{Synthetic respondents and the illusion of human data}},
  author    = {Lin, Zhicheng},
  howpublished = {PsyArXiv (OSF Preprints)},
  year      = {2025},
  doi       = {10.31234/osf.io/6q9ps_v1},
  url       = {https://doi.org/10.31234/osf.io/6q9ps_v1}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Social Sciences › Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse

  • attention checks
  • response bias
  • feedback loops
  • convenience sampling
  • stratified sampling

Work with this paper

Most-cited papers in Social Sciences

All highly cited Social Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Lin, Z. (2025). Synthetic respondents and the illusion of human data. PsyArXiv (OSF Preprints). https://doi.org/10.31234/osf.io/6q9ps_v1

How many times has this paper been cited?

0 times, according to OpenAlex on 18 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at PsyArXiv (OSF Preprints): sign in and open the full text from this page.

Who wrote this paper?

Zhicheng Lin.

What is the DOI of this paper?

10.31234/osf.io/6q9ps_v1, permanently at https://doi.org/10.31234/osf.io/6q9ps_v1. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 18 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.