Preprint · 2026 · Open access

CHARMS and PROT+AI: an updated template for Data Extraction and Risk of Bias Assessment in systematic reviews of prediction models

Anas Jaber, Lewis Thomas Hughes, Alan C. Cameron, Terence J. Quinn

medRxiv · Published 31 August 2026 · DOI 10.64898/2026.08.26.26361189

Read the free full textCite this paper

In brief

“CHARMS and PROT+AI: an updated template for Data Extraction and Risk of Bias Assessment in systematic reviews of prediction models” is a 2026 preprint by Anas Jaber and 3 co-authors, published in medRxiv. OpenAlex counts 1 citations as of 15 November 2026. It is open access under a CC BY licence: the full text is free to read at medRxiv.

Citations
1
Most cited in
2026 (1)
References
7
Authors
4

Abstract

Systematic reviews of clinical prediction models increasingly include studies using artificial intelligence (AI) and machine learning (ML) methods alongside traditional multivariable regression approaches. A previously published Excel tool enabled standardised data extraction using the CHARMS checklist and risk of bias assessment using PROBAST. The recent publication of the PROBAST+AI framework, which distinguishes the assessment of model development quality from the assessment of model evaluation risk of bias and assesses applicability in both parts, necessitates an updated digital instrument applicable across prediction modelling methods. We updated an open-access Excel tool to incorporate the full PROBAST+AI framework. The updated template incorporates structural separation between assessment of model development quality and model evaluation risk of bias, with applicability assessed in both parts. It also incorporates updated signalling questions, including those addressing methodological issues particularly relevant to AI/ML, and automates the generation of summary tables and graphical displays. The updated tool (CHARMS & PROBAST+AI Template) contains 11 worksheets and supports data extraction and appraisal for up to 30 prediction models. Dedicated, linked worksheets enable separate assessment of model development and model evaluation, with Domain 4 distinguishing among Apparent, Internal, and External evaluation settings. Key updates include dedicated assessments for predictor pre-processing, class imbalance handling and recalibration, data leakage prevention, and replication of the full model development pipeline within resampling procedures. Automated sheets dynamically format tables and summary charts covering PROBAST+AI parts. The CHARMS & PROBAST+AI Excel template provides a standardised, user-friendly, and rigorous digital framework for systematic reviewers appraising traditional statistical and AI-driven clinical prediction models.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Jaber, A., Hughes, L. T., Cameron, A. C., & Quinn, T. J. (2026). CHARMS and PROT+AI: an updated template for Data Extraction and Risk of Bias Assessment in systematic reviews of prediction models. medRxiv. https://doi.org/10.64898/2026.08.26.26361189

MLA 9

Jaber, Anas, et al. “CHARMS and PROT+AI: an updated template for Data Extraction and Risk of Bias Assessment in systematic reviews of prediction models.” medRxiv, 2026. https://doi.org/10.64898/2026.08.26.26361189.

Chicago

Jaber, Anas, Lewis Thomas Hughes, Alan C. Cameron, and Terence J. Quinn. 2026. “CHARMS and PROT+AI: an updated template for Data Extraction and Risk of Bias Assessment in systematic reviews of prediction models.” medRxiv. https://doi.org/10.64898/2026.08.26.26361189.

Harvard

Jaber, A. et al. (2026) ‘CHARMS and PROT+AI: an updated template for Data Extraction and Risk of Bias Assessment in systematic reviews of prediction models’, medRxiv. doi:10.64898/2026.08.26.26361189.

IEEE

A. Jaber, L. T. Hughes, A. C. Cameron, and T. J. Quinn, “CHARMS and PROT+AI: an updated template for Data Extraction and Risk of Bias Assessment in systematic reviews of prediction models,” medRxiv, 2026, doi: 10.64898/2026.08.26.26361189.

BibTeX

@misc{jaber2026charms,
  title     = {{CHARMS and PROT+AI: an updated template for Data Extraction and Risk of Bias Assessment in systematic reviews of prediction models}},
  author    = {Jaber, Anas and Hughes, Lewis Thomas and Cameron, Alan C. and Quinn, Terence J.},
  howpublished = {medRxiv},
  year      = {2026},
  doi       = {10.64898/2026.08.26.26361189},
  url       = {https://doi.org/10.64898/2026.08.26.26361189}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews

  • clinical prediction model
  • artificial intelligence
  • machine learning
  • PROBAST+AI
  • risk of bias assessment
  • data extraction template
  • model evaluation
  • applicability

Work with this paper

Most-cited papers in Decision Sciences

All highly cited Decision Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Jaber, A., Hughes, L. T., Cameron, A. C., & Quinn, T. J. (2026). CHARMS and PROT+AI: an updated template for Data Extraction and Risk of Bias Assessment in systematic reviews of prediction models. medRxiv. https://doi.org/10.64898/2026.08.26.26361189

How many times has this paper been cited?

1 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at medRxiv.

Who wrote this paper?

Anas Jaber, Lewis Thomas Hughes, Alan C. Cameron, Terence J. Quinn.

What is the DOI of this paper?

10.64898/2026.08.26.26361189. The permanent link is https://doi.org/10.64898/2026.08.26.26361189.

Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.