Preprint · 2025 · Open access
Exploring the Limits of Large Language Models as a Reflection of Human Cognition: An Illustration in the Context of Moral Judgement
arXiv (Cornell University) · Published 9 August 2025 · DOI 10.48550/arxiv.2508.06950
In brief
“Exploring the Limits of Large Language Models as a Reflection of Human Cognition: An Illustration in the Context of Moral Judgement” is a 2025 preprint by Sarah Schröder and 4 co-authors, published in arXiv (Cornell University). OpenAlex counts 57 citations as of 19 November 2026. It is open access under a CC BY-NC-ND licence: the full text is free to read at arXiv (Cornell University).
- Citations
- 57
- Most cited in
- 2026 (41)
- References
- 47
- Authors
- 5
Abstract
Large Language Models (LLMs), such as ChatGPT, are increasingly used in research, ranging from simple writing assistance to complex data annotation tasks. Recently, some research has suggested that LLMs are able to reproduce human responses to psychological questions and may, therefore, be used as simulators of human participants in some psychological research. We caution against this approach. Based on machine learning research, we argue that LLMs are likely to behave differently on novel stimuli compared to human study participants. We exemplify this in an experiment regarding moral judgments, demonstrating that slight changes to the wording of 30 moral scenarios used in prior work significantly reduce the similarity between ratings made by humans and LLMs, although the magnitude of this reduction varies across models. Therefore, we advise researchers to validate the similarity between human and LLM responses for their specific experiment.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Schröder, S., Morgenroth, T., Kuhl, U., Vaquet, V., & Paaßen, B. (2025). Exploring the Limits of Large Language Models as a Reflection of Human Cognition: An Illustration in the Context of Moral Judgement. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2508.06950
MLA 9
Schröder, Sarah, et al. “Exploring the Limits of Large Language Models as a Reflection of Human Cognition: An Illustration in the Context of Moral Judgement.” arXiv (Cornell University), 2025. https://doi.org/10.48550/arxiv.2508.06950.
Chicago
Schröder, Sarah, Thekla Morgenroth, Ulrike Kuhl, Valerie Vaquet, and Benjamin Paaßen. 2025. “Exploring the Limits of Large Language Models as a Reflection of Human Cognition: An Illustration in the Context of Moral Judgement.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.2508.06950.
Harvard
Schröder, S. et al. (2025) ‘Exploring the Limits of Large Language Models as a Reflection of Human Cognition: An Illustration in the Context of Moral Judgement’, arXiv (Cornell University). doi:10.48550/arxiv.2508.06950.
IEEE
S. Schröder, T. Morgenroth, U. Kuhl, V. Vaquet, and B. Paaßen, “Exploring the Limits of Large Language Models as a Reflection of Human Cognition: An Illustration in the Context of Moral Judgement,” arXiv (Cornell University), 2025, doi: 10.48550/arxiv.2508.06950.
BibTeX
@misc{schroder2025exploring,
title = {{Exploring the Limits of Large Language Models as a Reflection of Human Cognition: An Illustration in the Context of Moral Judgement}},
author = {Schröder, Sarah and Morgenroth, Thekla and Kuhl, Ulrike and Vaquet, Valerie and Paaßen, Benjamin},
howpublished = {arXiv (Cornell University)},
year = {2025},
doi = {10.48550/arxiv.2508.06950},
url = {https://doi.org/10.48550/arxiv.2508.06950}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Life Sciences › Neuroscience › Cognitive Neuroscience › Psychology of Moral and Emotional Judgment
- large language models
- ChatGPT
- moral judgment
- human cognition
- novel stimuli
- response similarity
- human-LLM comparison
Work with this paper
Most-cited papers in Neuroscience
- The Rat Brain in Stereotaxic CoordinatesGeorge Paxinos, CHARLES R. R. WATSON · Elsevier eBooks · 1982 · 52,413 citations
- The assessment and analysis of handedness: The Edinburgh inventoryRichard Charles Oldfield · Neuropsychologia · 1971 · 36,725 citations
- EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysisArnaud Delorme A, Scott Makeig · Journal of Neuroscience Methods · 2004 · 25,302 citations
- The Ecological Approach to Visual PerceptionMarc H. Bornstein, James J. Gibson · Journal of Aesthetics and Art Criticism · 1980 · 22,977 citations
- The Psychophysics ToolboxDavid H. Brainard · Spatial Vision · 1997 · 20,208 citations
Questions about this paper
How do I cite this paper in APA style?
Schröder, S., Morgenroth, T., Kuhl, U., Vaquet, V., & Paaßen, B. (2025). Exploring the Limits of Large Language Models as a Reflection of Human Cognition: An Illustration in the Context of Moral Judgement. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2508.06950
How many times has this paper been cited?
57 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.
Who wrote this paper?
Sarah Schröder, Thekla Morgenroth, Ulrike Kuhl, Valerie Vaquet, Benjamin Paaßen.
What is the DOI of this paper?
10.48550/arxiv.2508.06950, permanently at https://doi.org/10.48550/arxiv.2508.06950. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.