Journal article · 2021 · Open access

Protocol for development of a reporting guideline (TRIPOD-AI) and risk of bias tool (PROBAST-AI) for diagnostic and prognostic prediction model studies based on artificial intelligence

Professor Gary S. Collins, Paula Dhiman, Constanza L. Andaur Navarro, Jie Ma, Lotty Hooft, Johannes B. Reitsma, Patrícia Logullo, Andrew L. Beam, Lily H. Peng, Ben VAN CALSTER, Maarten van Smeden, Richard D Riley and 1 more

BMJ Open, 11(7), e048008 · Published 1 July 2021 · DOI 10.1136/bmjopen-2020-048008

Free PDFView at the publisherCite this paper

In brief

“Protocol for development of a reporting guideline (TRIPOD-AI) and risk of bias tool (PROBAST-AI) for diagnostic and prognostic prediction model studies based on artificial intelligence” is a 2021 journal article by Professor Gary S. Collins and 12 co-authors, published in BMJ Open. OpenAlex counts 918 citations as of 15 November 2026, which puts it in the top 1% of works published in 2021 by citations. It is open access under a CC BY licence: the full text is free to read at BMJ Open.

Citations
918
Most cited in
2026 (241)
Field-weighted impact
44.79
References
32
Authors
13

Abstract

INTRODUCTION: The Transparent Reporting of a multivariable prediction model of Individual Prognosis Or Diagnosis (TRIPOD) statement and the Prediction model Risk Of Bias ASsessment Tool (PROBAST) were both published to improve the reporting and critical appraisal of prediction model studies for diagnosis and prognosis. This paper describes the processes and methods that will be used to develop an extension to the TRIPOD statement (TRIPOD-artificial intelligence, AI) and the PROBAST (PROBAST-AI) tool for prediction model studies that applied machine learning techniques. METHODS AND ANALYSIS: TRIPOD-AI and PROBAST-AI will be developed following published guidance from the EQUATOR Network, and will comprise five stages. Stage 1 will comprise two systematic reviews (across all medical fields and specifically in oncology) to examine the quality of reporting in published machine-learning-based prediction model studies. In stage 2, we will consult a diverse group of key stakeholders using a Delphi process to identify items to be considered for inclusion in TRIPOD-AI and PROBAST-AI. Stage 3 will be virtual consensus meetings to consolidate and prioritise key items to be included in TRIPOD-AI and PROBAST-AI. Stage 4 will involve developing the TRIPOD-AI checklist and the PROBAST-AI tool, and writing the accompanying explanation and elaboration papers. In the final stage, stage 5, we will disseminate TRIPOD-AI and PROBAST-AI via journals, conferences, blogs, websites (including TRIPOD, PROBAST and EQUATOR Network) and social media. TRIPOD-AI will provide researchers working on prediction model studies based on machine learning with a reporting guideline that can help them report key details that readers need to evaluate the study quality and interpret its findings, potentially reducing research waste. We anticipate PROBAST-AI will help researchers, clinicians, systematic reviewers and policymakers critically appraise the design, conduct and analysis of machine learning based prediction model studies, with a robust standardised tool for bias evaluation. ETHICS AND DISSEMINATION: Ethical approval has been granted by the Central University Research Ethics Committee, University of Oxford on 10-December-2020 (R73034/RE001). Findings from this study will be disseminated through peer-review publications. PROSPERO REGISTRATION NUMBER: CRD42019140361 and CRD42019161764.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Collins, P. G. S., Dhiman, P., Navarro, C. L. A., Ma, J., Hooft, L., Reitsma, J. B., Logullo, P., Beam, A. L., Peng, L. H., VAN CALSTER, B., van Smeden, M., Riley, R. D., & Moons, K. G. (2021). Protocol for development of a reporting guideline (TRIPOD-AI) and risk of bias tool (PROBAST-AI) for diagnostic and prognostic prediction model studies based on artificial intelligence. BMJ Open, 11(7), e048008. https://doi.org/10.1136/bmjopen-2020-048008

MLA 9

Collins, Professor Gary S., et al. “Protocol for development of a reporting guideline (TRIPOD-AI) and risk of bias tool (PROBAST-AI) for diagnostic and prognostic prediction model studies based on artificial intelligence.” BMJ Open, vol. 11, no. 7, 2021, p. e048008. https://doi.org/10.1136/bmjopen-2020-048008.

Chicago

Collins, Professor Gary S., Paula Dhiman, Constanza L. Andaur Navarro, Jie Ma, Lotty Hooft, Johannes B. Reitsma, Patrícia Logullo, et al. 2021. “Protocol for development of a reporting guideline (TRIPOD-AI) and risk of bias tool (PROBAST-AI) for diagnostic and prognostic prediction model studies based on artificial intelligence.” BMJ Open 11 (7): e048008. https://doi.org/10.1136/bmjopen-2020-048008.

Harvard

Collins, P. G. S. et al. (2021) ‘Protocol for development of a reporting guideline (TRIPOD-AI) and risk of bias tool (PROBAST-AI) for diagnostic and prognostic prediction model studies based on artificial intelligence’, BMJ Open, 11(7), p. e048008. doi:10.1136/bmjopen-2020-048008.

IEEE

P. G. S. Collins et al., “Protocol for development of a reporting guideline (TRIPOD-AI) and risk of bias tool (PROBAST-AI) for diagnostic and prognostic prediction model studies based on artificial intelligence,” BMJ Open, vol. 11, no. 7, p. e048008, 2021, doi: 10.1136/bmjopen-2020-048008.

BibTeX

@article{collins2021protocol,
  title     = {{Protocol for development of a reporting guideline (TRIPOD-AI) and risk of bias tool (PROBAST-AI) for diagnostic and prognostic prediction model studies based on artificial intelligence}},
  author    = {Collins, Professor Gary S. and Dhiman, Paula and Navarro, Constanza L. Andaur and Ma, Jie and Hooft, Lotty and Reitsma, Johannes B. and Logullo, Patrícia and Beam, Andrew L. and Peng, Lily H. and VAN CALSTER, Ben and van Smeden, Maarten and Riley, Richard D and Moons, Karel G.M.},
  journal   = {BMJ Open},
  year      = {2021},
  volume    = {11},
  number    = {7},
  pages     = {e048008},
  doi       = {10.1136/bmjopen-2020-048008},
  url       = {https://doi.org/10.1136/bmjopen-2020-048008}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
20211111
2022107107
2023173173
2024201201
2025183183
2026241241

Its field-weighted citation impact is 44.79: it has been cited 44.79 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews

  • TRIPOD+AI
  • PROBAST+AI
  • reporting guidelines
  • risk of bias assessment
  • artificial intelligence
  • machine learning
  • diagnostic prediction model
  • prognostic model

Work with this paper

Most-cited papers in Decision Sciences

All highly cited Decision Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Collins, P. G. S., Dhiman, P., Navarro, C. L. A., Ma, J., Hooft, L., Reitsma, J. B., Logullo, P., Beam, A. L., Peng, L. H., VAN CALSTER, B., van Smeden, M., Riley, R. D., & Moons, K. G. (2021). Protocol for development of a reporting guideline (TRIPOD-AI) and risk of bias tool (PROBAST-AI) for diagnostic and prognostic prediction model studies based on artificial intelligence. BMJ Open, 11(7), e048008. https://doi.org/10.1136/bmjopen-2020-048008

How many times has this paper been cited?

918 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at BMJ Open.

Who wrote this paper?

Professor Gary S. Collins, Paula Dhiman, Constanza L. Andaur Navarro, Jie Ma, Lotty Hooft, Johannes B. Reitsma, Patrícia Logullo, Andrew L. Beam, Lily H. Peng, Ben VAN CALSTER, Maarten van Smeden, Richard D Riley and 1 more.

What is the DOI of this paper?

10.1136/bmjopen-2020-048008. The permanent link is https://doi.org/10.1136/bmjopen-2020-048008.

Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.