Preprint · 2024 · Open access
Comparing risk of bias assessments of randomized controlled trials created by a large language model versus human reviewers
OSF Preprints (OSF Preprints) · Published 17 December 2024
In brief
“Comparing risk of bias assessments of randomized controlled trials created by a large language model versus human reviewers” is a 2024 preprint by Judith-Lisa Lieberum and 7 co-authors, published in OSF Preprints (OSF Preprints). OpenAlex counts 0 citations as of 15 November 2026. It is open access under a CC BY licence: the full text is free to read at OSF Preprints (OSF Preprints).
- Citations
- 0
- Authors
- 8
Abstract
Conducting rigorous, high quality systematic reviews is usually an extensive, time-consuming process, especially requiring high personnel effort. In recent years, machine learning and automation techniques have gained increased attention to assist in performing selected steps of systematic reviews. We aim at using the Artificial Intelligence (AI) assistant “Claude” (Anthropic) to assess risk of bias of randomized controlled trials using the Cochrane Risk of Bias 2 tool (RoB 2).
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Lieberum, J.-L., Böhringer, D., Meerpohl, J. J., Toews, M., Haverkamp, C., Eisele-Metzger, A., Siemens, W., & Heilmeyer, F. (2024). Comparing risk of bias assessments of randomized controlled trials created by a large language model versus human reviewers. OSF Preprints (OSF Preprints). https://osf.io/2phyt
MLA 9
Lieberum, Judith-Lisa, et al. “Comparing risk of bias assessments of randomized controlled trials created by a large language model versus human reviewers.” OSF Preprints (OSF Preprints), 2024. https://osf.io/2phyt.
Chicago
Lieberum, Judith-Lisa, Daniel Böhringer, Joerg J Meerpohl, Markus Toews, Christian Haverkamp, Angelika Eisele-Metzger, Waldemar Siemens, and Felix Heilmeyer. 2024. “Comparing risk of bias assessments of randomized controlled trials created by a large language model versus human reviewers.” OSF Preprints (OSF Preprints). https://osf.io/2phyt.
Harvard
Lieberum, J.-L. et al. (2024) ‘Comparing risk of bias assessments of randomized controlled trials created by a large language model versus human reviewers’, OSF Preprints (OSF Preprints). Available at: https://osf.io/2phyt.
IEEE
J.-L. Lieberum et al., “Comparing risk of bias assessments of randomized controlled trials created by a large language model versus human reviewers,” OSF Preprints (OSF Preprints), 2024.
BibTeX
@misc{lieberum2024comparing,
title = {{Comparing risk of bias assessments of randomized controlled trials created by a large language model versus human reviewers}},
author = {Lieberum, Judith-Lisa and Böhringer, Daniel and Meerpohl, Joerg J and Toews, Markus and Haverkamp, Christian and Eisele-Metzger, Angelika and Siemens, Waldemar and Heilmeyer, Felix},
howpublished = {OSF Preprints (OSF Preprints)},
year = {2024},
url = {https://osf.io/2phyt}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- risk of bias assessment
- randomized controlled trials
- large language models
- Claude
- human-AI comparison
Work with this paper
Most-cited papers in Decision Sciences
- The PRISMA 2020 statement: an updated guideline for reporting systematic reviewsMatthew James Page, Joanne E. McKenzie, Patrick M. Bossuyt and 23 more · BMJ · 2021 · 144,919 citations
- Evaluating Structural Equation Models with Unobservable Variables and Measurement ErrorClaes Fornell, David F. Larcker · Journal of Marketing Research · 1981 · 118,336 citations
- Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternativesLi‐tze Hu, Peter M. Bentler · Structural Equation Modeling A Multidisciplinary Journal · 1999 · 117,461 citations
- Common method biases in behavioral research: A critical review of the literature and recommended remedies.Philip M. Podsakoff, SCOTT B. MACKENZIE, Jeong Yeon Lee and 1 more · Journal of Applied Psychology · 2003 · 89,248 citations
- Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statementDavid Moher, Alessandro Liberati, Jennifer Tetzlaff and 2 more · BMJ · 2009 · 85,524 citations
Questions about this paper
How do I cite this paper in APA style?
Lieberum, J.-L., Böhringer, D., Meerpohl, J. J., Toews, M., Haverkamp, C., Eisele-Metzger, A., Siemens, W., & Heilmeyer, F. (2024). Comparing risk of bias assessments of randomized controlled trials created by a large language model versus human reviewers. OSF Preprints (OSF Preprints). https://osf.io/2phyt
How many times has this paper been cited?
0 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text at OSF Preprints (OSF Preprints).
Who wrote this paper?
Judith-Lisa Lieberum, Daniel Böhringer, Joerg J Meerpohl, Markus Toews, Christian Haverkamp, Angelika Eisele-Metzger, Waldemar Siemens, Felix Heilmeyer.
Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.