Preprint · 2024 · Open access

Comparing risk of bias assessments of randomized controlled trials created by a large language model versus human reviewers

Judith-Lisa Lieberum, Daniel Böhringer, Joerg J Meerpohl, Markus Toews, Christian Haverkamp, Angelika Eisele-Metzger, Waldemar Siemens, Felix Heilmeyer

OSF Preprints (OSF Preprints) · Published 17 December 2024

Read the free full textCite this paper

In brief

“Comparing risk of bias assessments of randomized controlled trials created by a large language model versus human reviewers” is a 2024 preprint by Judith-Lisa Lieberum and 7 co-authors, published in OSF Preprints (OSF Preprints). OpenAlex counts 0 citations as of 15 November 2026. It is open access under a CC BY licence: the full text is free to read at OSF Preprints (OSF Preprints).

Citations
0
Authors
8

Abstract

Conducting rigorous, high quality systematic reviews is usually an extensive, time-consuming process, especially requiring high personnel effort. In recent years, machine learning and automation techniques have gained increased attention to assist in performing selected steps of systematic reviews. We aim at using the Artificial Intelligence (AI) assistant “Claude” (Anthropic) to assess risk of bias of randomized controlled trials using the Cochrane Risk of Bias 2 tool (RoB 2).

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Lieberum, J.-L., Böhringer, D., Meerpohl, J. J., Toews, M., Haverkamp, C., Eisele-Metzger, A., Siemens, W., & Heilmeyer, F. (2024). Comparing risk of bias assessments of randomized controlled trials created by a large language model versus human reviewers. OSF Preprints (OSF Preprints). https://osf.io/2phyt

MLA 9

Lieberum, Judith-Lisa, et al. “Comparing risk of bias assessments of randomized controlled trials created by a large language model versus human reviewers.” OSF Preprints (OSF Preprints), 2024. https://osf.io/2phyt.

Chicago

Lieberum, Judith-Lisa, Daniel Böhringer, Joerg J Meerpohl, Markus Toews, Christian Haverkamp, Angelika Eisele-Metzger, Waldemar Siemens, and Felix Heilmeyer. 2024. “Comparing risk of bias assessments of randomized controlled trials created by a large language model versus human reviewers.” OSF Preprints (OSF Preprints). https://osf.io/2phyt.

Harvard

Lieberum, J.-L. et al. (2024) ‘Comparing risk of bias assessments of randomized controlled trials created by a large language model versus human reviewers’, OSF Preprints (OSF Preprints). Available at: https://osf.io/2phyt.

IEEE

J.-L. Lieberum et al., “Comparing risk of bias assessments of randomized controlled trials created by a large language model versus human reviewers,” OSF Preprints (OSF Preprints), 2024.

BibTeX

@misc{lieberum2024comparing,
  title     = {{Comparing risk of bias assessments of randomized controlled trials created by a large language model versus human reviewers}},
  author    = {Lieberum, Judith-Lisa and Böhringer, Daniel and Meerpohl, Joerg J and Toews, Markus and Haverkamp, Christian and Eisele-Metzger, Angelika and Siemens, Waldemar and Heilmeyer, Felix},
  howpublished = {OSF Preprints (OSF Preprints)},
  year      = {2024},
  url       = {https://osf.io/2phyt}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews

  • risk of bias assessment
  • randomized controlled trials
  • large language models
  • Claude
  • human-AI comparison

Work with this paper

Most-cited papers in Decision Sciences

All highly cited Decision Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Lieberum, J.-L., Böhringer, D., Meerpohl, J. J., Toews, M., Haverkamp, C., Eisele-Metzger, A., Siemens, W., & Heilmeyer, F. (2024). Comparing risk of bias assessments of randomized controlled trials created by a large language model versus human reviewers. OSF Preprints (OSF Preprints). https://osf.io/2phyt

How many times has this paper been cited?

0 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at OSF Preprints (OSF Preprints).

Who wrote this paper?

Judith-Lisa Lieberum, Daniel Böhringer, Joerg J Meerpohl, Markus Toews, Christian Haverkamp, Angelika Eisele-Metzger, Waldemar Siemens, Felix Heilmeyer.

Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.