Preprint · 2026 · Open access

Large language models for conducting risk of bias assessments during systematic reviews

Petek Eylul Taneri, Juan Víctor Ariel Franco, Brenda W. C. Bongaerts, Camila Micaela Escobar Liquitay

Published 1 January 2026 · DOI 10.17605/osf.io/py4vb

Open full textCite this paper

In brief

“Large language models for conducting risk of bias assessments during systematic reviews” is a 2026 preprint by Petek Eylul Taneri and 3 co-authors. OpenAlex counts 0 citations as of 19 November 2026. It is open access: the full text is free to read at Open Science Framework.

Citations
0
Authors
4

Abstract

Large language models (LLMs) are increasingly being explored as tools to support systematic reviews, including the assessment of risk of bias (RoB), a critical but time-consuming step in evidence synthesis. Although several studies suggest that LLMs may assist or partially automate RoB assessments, the existing evidence is fragmented, methodologically heterogeneous, and limited by small sample sizes and inconsistent reporting. As a result, it remains unclear how accurately and reliably LLMs perform, how they should be integrated into review workflows, and what risks they may pose, such as hallucinations or lack of transparency. This project is a systematic review of evaluation studies examining the use of LLMs for RoB assessment in health-related systematic reviews. We will include studies that use LLMs alone, compare LLM-generated judgments with those of human reviewers, or apply hybrid human–AI workflows. The primary outcomes are accuracy and reliability, assessed through agreement with reference judgments and diagnostic accuracy metrics. Secondary outcomes include efficiency (e.g., time savings), usability and acceptability, and quality-of-output issues such as hallucinations and incomplete outputs. Searches will be conducted across major bibliographic databases, preprint servers, and additional sources without language or date restrictions. Two reviewers will independently screen studies, extract data, and assess methodological quality using QUADAS-2 or QUADAS-C, supplemented with LLM-specific signalling questions. Where appropriate, quantitative synthesis will be performed using hierarchical models; otherwise, findings will be summarised narratively. The review will provide a comprehensive overview of current evidence on LLMs for RoB assessment, identify methodological gaps, and inform future research and responsible implementation of AI-supported approaches in systematic review workflows.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Taneri, P. E., Franco, J. V. A., Bongaerts, B. W. C., & Liquitay, C. M. E. (2026). Large language models for conducting risk of bias assessments during systematic reviews. https://doi.org/10.17605/osf.io/py4vb

MLA 9

Taneri, Petek Eylul, et al. “Large language models for conducting risk of bias assessments during systematic reviews.” 2026. https://doi.org/10.17605/osf.io/py4vb.

Chicago

Taneri, Petek Eylul, Juan Víctor Ariel Franco, Brenda W. C. Bongaerts, and Camila Micaela Escobar Liquitay. 2026. “Large language models for conducting risk of bias assessments during systematic reviews.” https://doi.org/10.17605/osf.io/py4vb.

Harvard

Taneri, P. E. et al. (2026) ‘Large language models for conducting risk of bias assessments during systematic reviews’. doi:10.17605/osf.io/py4vb.

IEEE

P. E. Taneri, J. V. A. Franco, B. W. C. Bongaerts, and C. M. E. Liquitay, “Large language models for conducting risk of bias assessments during systematic reviews,” 2026, doi: 10.17605/osf.io/py4vb.

BibTeX

@misc{taneri2026large,
  title     = {{Large language models for conducting risk of bias assessments during systematic reviews}},
  author    = {Taneri, Petek Eylul and Franco, Juan Víctor Ariel and Bongaerts, Brenda W. C. and Liquitay, Camila Micaela Escobar},
  year      = {2026},
  doi       = {10.17605/osf.io/py4vb},
  url       = {https://doi.org/10.17605/osf.io/py4vb}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews

  • large language models
  • risk of bias assessment
  • systematic reviews
  • AI-assisted review
  • human-AI collaboration
  • hallucinations
  • diagnostic accuracy
  • QUADAS-2

Work with this paper

Most-cited papers in Decision Sciences

All highly cited Decision Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Taneri, P. E., Franco, J. V. A., Bongaerts, B. W. C., & Liquitay, C. M. E. (2026). Large language models for conducting risk of bias assessments during systematic reviews. https://doi.org/10.17605/osf.io/py4vb

How many times has this paper been cited?

0 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at Open Science Framework: sign in and open the full text from this page.

Who wrote this paper?

Petek Eylul Taneri, Juan Víctor Ariel Franco, Brenda W. C. Bongaerts, Camila Micaela Escobar Liquitay.

What is the DOI of this paper?

10.17605/osf.io/py4vb, permanently at https://doi.org/10.17605/osf.io/py4vb. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.