Journal article · 2018 · Open access

PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies

Robert F. Wolff, Karel G.M. Moons, Richard D Riley, Penny F. Whiting, Marie E. Westwood, Professor Gary S. Collins, Johannes B. Reitsma, Jos Kleijnen, Susan Mallett, for the PROBAST Group†

Annals of Internal Medicine, 170(1), 51–58 · Published 31 December 2018 · DOI 10.7326/m18-1376

Read the free full textView at the publisherCite this paper

In brief

“PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies” is a 2018 journal article by Robert F. Wolff and 9 co-authors, published in Annals of Internal Medicine. OpenAlex counts 3,357 citations as of 15 November 2026. It is open access: the full text is free to read at Research Publications (Maastricht University).

Citations
3,357
Most cited in
2026 (1,256)
Field-weighted impact
41.25
References
42
Authors
10

Abstract

Clinical prediction models combine multiple predictors to estimate risk for the presence of a particular condition (diagnostic models) or the occurrence of a certain event in the future (prognostic models). PROBAST (Prediction model Risk Of Bias ASsessment Tool), a tool for assessing the risk of bias (ROB) and applicability of diagnostic and prognostic prediction model studies, was developed by a steering group that considered existing ROB tools and reporting guidelines. The tool was informed by a Delphi procedure involving 38 experts and was refined through piloting. PROBAST is organized into the following 4 domains: participants, predictors, outcome, and analysis. These domains contain a total of 20 signaling questions to facilitate structured judgment of ROB, which was defined to occur when shortcomings in study design, conduct, or analysis lead to systematically distorted estimates of model predictive performance. PROBAST enables a focused and transparent approach to assessing the ROB and applicability of studies that develop, validate, or update prediction models for individualized predictions. Although PROBAST was designed for systematic reviews, it can be used more generally in critical appraisal of prediction model studies. Potential users include organizations supporting decision making, researchers and clinicians who are interested in evidence-based medicine or involved in guideline development, journal editors, and manuscript reviewers.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Wolff, R. F., Moons, K. G., Riley, R. D., Whiting, P. F., Westwood, M. E., Collins, P. G. S., Reitsma, J. B., Kleijnen, J., Mallett, S., & for the PROBAST Group†. (2018). PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies. Annals of Internal Medicine, 170(1), 51–58. https://doi.org/10.7326/m18-1376

MLA 9

Wolff, Robert F., et al. “PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies.” Annals of Internal Medicine, vol. 170, no. 1, 2018, pp. 51–58. https://doi.org/10.7326/m18-1376.

Chicago

Wolff, Robert F., Karel G.M. Moons, Richard D Riley, Penny F. Whiting, Marie E. Westwood, Professor Gary S. Collins, Johannes B. Reitsma, Jos Kleijnen, Susan Mallett, and for the PROBAST Group†. 2018. “PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies.” Annals of Internal Medicine 170 (1): 51–58. https://doi.org/10.7326/m18-1376.

Harvard

Wolff, R. F. et al. (2018) ‘PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies’, Annals of Internal Medicine, 170(1), pp. 51–58. doi:10.7326/m18-1376.

IEEE

R. F. Wolff et al., “PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies,” Annals of Internal Medicine, vol. 170, no. 1, pp. 51–58, 2018, doi: 10.7326/m18-1376.

BibTeX

@article{wolff2018probast,
  title     = {{PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies}},
  author    = {Wolff, Robert F. and Moons, Karel G.M. and Riley, Richard D and Whiting, Penny F. and Westwood, Marie E. and Collins, Professor Gary S. and Reitsma, Johannes B. and Kleijnen, Jos and Mallett, Susan and for the PROBAST Group†},
  journal   = {Annals of Internal Medicine},
  year      = {2018},
  volume    = {170},
  number    = {1},
  pages     = {51--58},
  doi       = {10.7326/m18-1376},
  url       = {https://doi.org/10.7326/m18-1376}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
201311
201844
20194444
2020137137
2021247247
2022304304
2023351351
2024426426
2025584584
20261,2561256

Its field-weighted citation impact is 41.25: it has been cited 41.25 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews

  • PROBAST
  • risk of bias assessment
  • diagnostic model
  • prognostic model
  • applicability
  • critical appraisal
  • reporting guidelines
  • Delphi consensus

Work with this paper

Most-cited papers in Decision Sciences

All highly cited Decision Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Wolff, R. F., Moons, K. G., Riley, R. D., Whiting, P. F., Westwood, M. E., Collins, P. G. S., Reitsma, J. B., Kleijnen, J., Mallett, S., & for the PROBAST Group†. (2018). PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies. Annals of Internal Medicine, 170(1), 51–58. https://doi.org/10.7326/m18-1376

How many times has this paper been cited?

3,357 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at Research Publications (Maastricht University).

Who wrote this paper?

Robert F. Wolff, Karel G.M. Moons, Richard D Riley, Penny F. Whiting, Marie E. Westwood, Professor Gary S. Collins, Johannes B. Reitsma, Jos Kleijnen, Susan Mallett, for the PROBAST Group†.

What is the DOI of this paper?

10.7326/m18-1376. The permanent link is https://doi.org/10.7326/m18-1376.

Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.