Review article · 2026 · Open access
Artificial intelligence tools for automating assessments of reporting guideline adherence: a protocol for a systematic review
F1000Research, 15, 626 · Published 28 April 2026 · DOI 10.12688/f1000research.179775.2
In brief
“Artificial intelligence tools for automating assessments of reporting guideline adherence: a protocol for a systematic review” is a 2026 review article by Minyan Zeng and 13 co-authors, published in F1000Research. OpenAlex counts 1 citations as of 15 November 2026, which puts it in the top 9% of works published in 2026 by citations. It is open access under a CC BY licence: the full text is free to read at F1000Research.
- Citations
- 1
- Most cited in
- 2026 (1)
- Field-weighted impact
- 0.76
- References
- 20
- Authors
- 14
Abstract
Background Complete reporting of health-related research is necessary for users to understand, appraise, and apply research results appropriately. Reporting guidelines have been developed to support complete reporting. However, assessments of reporting guideline adherence remain inconsistent, time-consuming, and difficult to scale. Artificial intelligence (AI) tools, such as traditional natural language processing models and large language models, might provide a potential solution. While numerous AI tools have been developed, no comprehensive synthesis has been undertaken to investigate what they assess, how they are implemented and perform, and their potential utility. Objective This systematic review aims to synthesise the characteristics and findings of studies evaluating AI tools developed to assist or automate assessments of reporting guideline adherence. Methods We will search MEDLINE, Embase, Scopus, Europe PMC, ACM Digital Library, IEEE Xplore, arXiv and Cochrane Colloquium Abstracts, with no restrictions on date, language, or publication type. We will include studies that evaluate AI tools to assess adherence of health-related papers to any reporting guidelines. Two authors will independently screen records, extract data and assess risk of bias. We will extract study characteristics, AI tool details, how reporting guidelines are operationalised for AI assessment, AI implementation details, comparison details, and evaluation outcomes including agreement metrics, classification performance metrics, and utility indicators. We will present and summarise results through structured tables and plots, stratified by reporting guideline and AI tool type. Discussion This systematic review will provide a comprehensive synthesis of AI tools developed to automate assessments of reporting guideline adherence. It will provide interest holders with insights into what AI tools have been used, their implementation approaches, which AI tool types perform well, and any improvements that can be made to AI tools automating assessments of reporting guideline adherence in the future.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Zeng, M., Liu, S., Clark, D. P., McDonald, S. J., Mayo‐Wilson, E., Ying, X., Menke, J., Lan, M., Jiang, L., Ninan, K., Oberste, J.-P., McKenzie, J. E., B, H. K., & Page, M. J. (2026). Artificial intelligence tools for automating assessments of reporting guideline adherence: a protocol for a systematic review. F1000Research, 15, 626. https://doi.org/10.12688/f1000research.179775.2
MLA 9
Zeng, Minyan, et al. “Artificial intelligence tools for automating assessments of reporting guideline adherence: a protocol for a systematic review.” F1000Research, vol. 15, 2026, p. 626. https://doi.org/10.12688/f1000research.179775.2.
Chicago
Zeng, Minyan, Shiwei Liu, David PQ Clark, Steve J McDonald, Evan Mayo‐Wilson, Xiangji Ying, Joe Menke, et al. 2026. “Artificial intelligence tools for automating assessments of reporting guideline adherence: a protocol for a systematic review.” F1000Research 15: 626. https://doi.org/10.12688/f1000research.179775.2.
Harvard
Zeng, M. et al. (2026) ‘Artificial intelligence tools for automating assessments of reporting guideline adherence: a protocol for a systematic review’, F1000Research, 15, p. 626. doi:10.12688/f1000research.179775.2.
IEEE
M. Zeng et al., “Artificial intelligence tools for automating assessments of reporting guideline adherence: a protocol for a systematic review,” F1000Research, vol. 15, p. 626, 2026, doi: 10.12688/f1000research.179775.2.
BibTeX
@article{zeng2026artificial,
title = {{Artificial intelligence tools for automating assessments of reporting guideline adherence: a protocol for a systematic review}},
author = {Zeng, Minyan and Liu, Shiwei and Clark, David PQ and McDonald, Steve J and Mayo‐Wilson, Evan and Ying, Xiangji and Menke, Joe and Lan, Mengfei and Jiang, Lan and Ninan, Kiran and Oberste, Jean-Pierre and McKenzie, Joanne E. and B, Halil Kilicoglu and Page, Matthew James},
journal = {F1000Research},
year = {2026},
volume = {15},
pages = {626},
doi = {10.12688/f1000research.179775.2},
url = {https://doi.org/10.12688/f1000research.179775.2}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- AI tools
- large language models
- natural language processing
- automated assessment
- reporting guidelines
- AI tool evaluation
- classification performance
Work with this paper
Most-cited papers in Decision Sciences
- The PRISMA 2020 statement: an updated guideline for reporting systematic reviewsMatthew James Page, Joanne E. McKenzie, Patrick M. Bossuyt and 23 more · BMJ · 2021 · 144,919 citations
- Evaluating Structural Equation Models with Unobservable Variables and Measurement ErrorClaes Fornell, David F. Larcker · Journal of Marketing Research · 1981 · 118,336 citations
- Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternativesLi‐tze Hu, Peter M. Bentler · Structural Equation Modeling A Multidisciplinary Journal · 1999 · 117,461 citations
- Common method biases in behavioral research: A critical review of the literature and recommended remedies.Philip M. Podsakoff, SCOTT B. MACKENZIE, Jeong Yeon Lee and 1 more · Journal of Applied Psychology · 2003 · 89,248 citations
- Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statementDavid Moher, Alessandro Liberati, Jennifer Tetzlaff and 2 more · BMJ · 2009 · 85,524 citations
Questions about this paper
How do I cite this paper in APA style?
Zeng, M., Liu, S., Clark, D. P., McDonald, S. J., Mayo‐Wilson, E., Ying, X., Menke, J., Lan, M., Jiang, L., Ninan, K., Oberste, J.-P., McKenzie, J. E., B, H. K., & Page, M. J. (2026). Artificial intelligence tools for automating assessments of reporting guideline adherence: a protocol for a systematic review. F1000Research, 15, 626. https://doi.org/10.12688/f1000research.179775.2
How many times has this paper been cited?
1 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text at F1000Research.
Who wrote this paper?
Minyan Zeng, Shiwei Liu, David PQ Clark, Steve J McDonald, Evan Mayo‐Wilson, Xiangji Ying, Joe Menke, Mengfei Lan, Lan Jiang, Kiran Ninan, Jean-Pierre Oberste, Joanne E. McKenzie and 2 more.
What is the DOI of this paper?
10.12688/f1000research.179775.2. The permanent link is https://doi.org/10.12688/f1000research.179775.2.
Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.