Review article · 2026 · Open access

Artificial intelligence tools for automating assessments of reporting guideline adherence: a protocol for a systematic review

Minyan Zeng, Shiwei Liu, David PQ Clark, Steve J McDonald, Evan Mayo‐Wilson, Xiangji Ying, Joe Menke, Mengfei Lan, Lan Jiang, Kiran Ninan, Jean-Pierre Oberste, Joanne E. McKenzie and 2 more

F1000Research, 15, 626 · Published 28 April 2026 · DOI 10.12688/f1000research.179775.2

Read the free full textCite this paper

In brief

“Artificial intelligence tools for automating assessments of reporting guideline adherence: a protocol for a systematic review” is a 2026 review article by Minyan Zeng and 13 co-authors, published in F1000Research. OpenAlex counts 1 citations as of 15 November 2026, which puts it in the top 9% of works published in 2026 by citations. It is open access under a CC BY licence: the full text is free to read at F1000Research.

Citations
1
Most cited in
2026 (1)
Field-weighted impact
0.76
References
20
Authors
14

Abstract

Background Complete reporting of health-related research is necessary for users to understand, appraise, and apply research results appropriately. Reporting guidelines have been developed to support complete reporting. However, assessments of reporting guideline adherence remain inconsistent, time-consuming, and difficult to scale. Artificial intelligence (AI) tools, such as traditional natural language processing models and large language models, might provide a potential solution. While numerous AI tools have been developed, no comprehensive synthesis has been undertaken to investigate what they assess, how they are implemented and perform, and their potential utility. Objective This systematic review aims to synthesise the characteristics and findings of studies evaluating AI tools developed to assist or automate assessments of reporting guideline adherence. Methods We will search MEDLINE, Embase, Scopus, Europe PMC, ACM Digital Library, IEEE Xplore, arXiv and Cochrane Colloquium Abstracts, with no restrictions on date, language, or publication type. We will include studies that evaluate AI tools to assess adherence of health-related papers to any reporting guidelines. Two authors will independently screen records, extract data and assess risk of bias. We will extract study characteristics, AI tool details, how reporting guidelines are operationalised for AI assessment, AI implementation details, comparison details, and evaluation outcomes including agreement metrics, classification performance metrics, and utility indicators. We will present and summarise results through structured tables and plots, stratified by reporting guideline and AI tool type. Discussion This systematic review will provide a comprehensive synthesis of AI tools developed to automate assessments of reporting guideline adherence. It will provide interest holders with insights into what AI tools have been used, their implementation approaches, which AI tool types perform well, and any improvements that can be made to AI tools automating assessments of reporting guideline adherence in the future.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Zeng, M., Liu, S., Clark, D. P., McDonald, S. J., Mayo‐Wilson, E., Ying, X., Menke, J., Lan, M., Jiang, L., Ninan, K., Oberste, J.-P., McKenzie, J. E., B, H. K., & Page, M. J. (2026). Artificial intelligence tools for automating assessments of reporting guideline adherence: a protocol for a systematic review. F1000Research, 15, 626. https://doi.org/10.12688/f1000research.179775.2

MLA 9

Zeng, Minyan, et al. “Artificial intelligence tools for automating assessments of reporting guideline adherence: a protocol for a systematic review.” F1000Research, vol. 15, 2026, p. 626. https://doi.org/10.12688/f1000research.179775.2.

Chicago

Zeng, Minyan, Shiwei Liu, David PQ Clark, Steve J McDonald, Evan Mayo‐Wilson, Xiangji Ying, Joe Menke, et al. 2026. “Artificial intelligence tools for automating assessments of reporting guideline adherence: a protocol for a systematic review.” F1000Research 15: 626. https://doi.org/10.12688/f1000research.179775.2.

Harvard

Zeng, M. et al. (2026) ‘Artificial intelligence tools for automating assessments of reporting guideline adherence: a protocol for a systematic review’, F1000Research, 15, p. 626. doi:10.12688/f1000research.179775.2.

IEEE

M. Zeng et al., “Artificial intelligence tools for automating assessments of reporting guideline adherence: a protocol for a systematic review,” F1000Research, vol. 15, p. 626, 2026, doi: 10.12688/f1000research.179775.2.

BibTeX

@article{zeng2026artificial,
  title     = {{Artificial intelligence tools for automating assessments of reporting guideline adherence: a protocol for a systematic review}},
  author    = {Zeng, Minyan and Liu, Shiwei and Clark, David PQ and McDonald, Steve J and Mayo‐Wilson, Evan and Ying, Xiangji and Menke, Joe and Lan, Mengfei and Jiang, Lan and Ninan, Kiran and Oberste, Jean-Pierre and McKenzie, Joanne E. and B, Halil Kilicoglu and Page, Matthew James},
  journal   = {F1000Research},
  year      = {2026},
  volume    = {15},
  pages     = {626},
  doi       = {10.12688/f1000research.179775.2},
  url       = {https://doi.org/10.12688/f1000research.179775.2}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews

  • AI tools
  • large language models
  • natural language processing
  • automated assessment
  • reporting guidelines
  • AI tool evaluation
  • classification performance

Work with this paper

Most-cited papers in Decision Sciences

All highly cited Decision Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Zeng, M., Liu, S., Clark, D. P., McDonald, S. J., Mayo‐Wilson, E., Ying, X., Menke, J., Lan, M., Jiang, L., Ninan, K., Oberste, J.-P., McKenzie, J. E., B, H. K., & Page, M. J. (2026). Artificial intelligence tools for automating assessments of reporting guideline adherence: a protocol for a systematic review. F1000Research, 15, 626. https://doi.org/10.12688/f1000research.179775.2

How many times has this paper been cited?

1 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at F1000Research.

Who wrote this paper?

Minyan Zeng, Shiwei Liu, David PQ Clark, Steve J McDonald, Evan Mayo‐Wilson, Xiangji Ying, Joe Menke, Mengfei Lan, Lan Jiang, Kiran Ninan, Jean-Pierre Oberste, Joanne E. McKenzie and 2 more.

What is the DOI of this paper?

10.12688/f1000research.179775.2. The permanent link is https://doi.org/10.12688/f1000research.179775.2.

Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.