Journal article · 2018 · Open access
PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies
Annals of Internal Medicine, 170(1), 51–58 · Published 31 December 2018 · DOI 10.7326/m18-1376
In brief
“PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies” is a 2018 journal article by Robert F. Wolff and 9 co-authors, published in Annals of Internal Medicine. OpenAlex counts 3,357 citations as of 15 November 2026. It is open access: the full text is free to read at Research Publications (Maastricht University).
- Citations
- 3,357
- Most cited in
- 2026 (1,256)
- Field-weighted impact
- 41.25
- References
- 42
- Authors
- 10
Abstract
Clinical prediction models combine multiple predictors to estimate risk for the presence of a particular condition (diagnostic models) or the occurrence of a certain event in the future (prognostic models). PROBAST (Prediction model Risk Of Bias ASsessment Tool), a tool for assessing the risk of bias (ROB) and applicability of diagnostic and prognostic prediction model studies, was developed by a steering group that considered existing ROB tools and reporting guidelines. The tool was informed by a Delphi procedure involving 38 experts and was refined through piloting. PROBAST is organized into the following 4 domains: participants, predictors, outcome, and analysis. These domains contain a total of 20 signaling questions to facilitate structured judgment of ROB, which was defined to occur when shortcomings in study design, conduct, or analysis lead to systematically distorted estimates of model predictive performance. PROBAST enables a focused and transparent approach to assessing the ROB and applicability of studies that develop, validate, or update prediction models for individualized predictions. Although PROBAST was designed for systematic reviews, it can be used more generally in critical appraisal of prediction model studies. Potential users include organizations supporting decision making, researchers and clinicians who are interested in evidence-based medicine or involved in guideline development, journal editors, and manuscript reviewers.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Wolff, R. F., Moons, K. G., Riley, R. D., Whiting, P. F., Westwood, M. E., Collins, P. G. S., Reitsma, J. B., Kleijnen, J., Mallett, S., & for the PROBAST Group†. (2018). PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies. Annals of Internal Medicine, 170(1), 51–58. https://doi.org/10.7326/m18-1376
MLA 9
Wolff, Robert F., et al. “PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies.” Annals of Internal Medicine, vol. 170, no. 1, 2018, pp. 51–58. https://doi.org/10.7326/m18-1376.
Chicago
Wolff, Robert F., Karel G.M. Moons, Richard D Riley, Penny F. Whiting, Marie E. Westwood, Professor Gary S. Collins, Johannes B. Reitsma, Jos Kleijnen, Susan Mallett, and for the PROBAST Group†. 2018. “PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies.” Annals of Internal Medicine 170 (1): 51–58. https://doi.org/10.7326/m18-1376.
Harvard
Wolff, R. F. et al. (2018) ‘PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies’, Annals of Internal Medicine, 170(1), pp. 51–58. doi:10.7326/m18-1376.
IEEE
R. F. Wolff et al., “PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies,” Annals of Internal Medicine, vol. 170, no. 1, pp. 51–58, 2018, doi: 10.7326/m18-1376.
BibTeX
@article{wolff2018probast,
title = {{PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies}},
author = {Wolff, Robert F. and Moons, Karel G.M. and Riley, Richard D and Whiting, Penny F. and Westwood, Marie E. and Collins, Professor Gary S. and Reitsma, Johannes B. and Kleijnen, Jos and Mallett, Susan and for the PROBAST Group†},
journal = {Annals of Internal Medicine},
year = {2018},
volume = {170},
number = {1},
pages = {51--58},
doi = {10.7326/m18-1376},
url = {https://doi.org/10.7326/m18-1376}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2013 | 1 | |
| 2018 | 4 | |
| 2019 | 44 | |
| 2020 | 137 | |
| 2021 | 247 | |
| 2022 | 304 | |
| 2023 | 351 | |
| 2024 | 426 | |
| 2025 | 584 | |
| 2026 | 1,256 |
Its field-weighted citation impact is 41.25: it has been cited 41.25 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- PROBAST
- risk of bias assessment
- diagnostic model
- prognostic model
- applicability
- critical appraisal
- reporting guidelines
- Delphi consensus
Work with this paper
Most-cited papers in Decision Sciences
- The PRISMA 2020 statement: an updated guideline for reporting systematic reviewsMatthew James Page, Joanne E. McKenzie, Patrick M. Bossuyt and 23 more · BMJ · 2021 · 144,919 citations
- Evaluating Structural Equation Models with Unobservable Variables and Measurement ErrorClaes Fornell, David F. Larcker · Journal of Marketing Research · 1981 · 118,336 citations
- Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternativesLi‐tze Hu, Peter M. Bentler · Structural Equation Modeling A Multidisciplinary Journal · 1999 · 117,461 citations
- Common method biases in behavioral research: A critical review of the literature and recommended remedies.Philip M. Podsakoff, SCOTT B. MACKENZIE, Jeong Yeon Lee and 1 more · Journal of Applied Psychology · 2003 · 89,248 citations
- Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statementDavid Moher, Alessandro Liberati, Jennifer Tetzlaff and 2 more · BMJ · 2009 · 85,524 citations
Questions about this paper
How do I cite this paper in APA style?
Wolff, R. F., Moons, K. G., Riley, R. D., Whiting, P. F., Westwood, M. E., Collins, P. G. S., Reitsma, J. B., Kleijnen, J., Mallett, S., & for the PROBAST Group†. (2018). PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies. Annals of Internal Medicine, 170(1), 51–58. https://doi.org/10.7326/m18-1376
How many times has this paper been cited?
3,357 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text at Research Publications (Maastricht University).
Who wrote this paper?
Robert F. Wolff, Karel G.M. Moons, Richard D Riley, Penny F. Whiting, Marie E. Westwood, Professor Gary S. Collins, Johannes B. Reitsma, Jos Kleijnen, Susan Mallett, for the PROBAST Group†.
What is the DOI of this paper?
10.7326/m18-1376. The permanent link is https://doi.org/10.7326/m18-1376.
Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.