Journal article · 2021 · Open access

Appraising prediction research: a guide and meta‐review on bias and applicability assessment using the Prediction model Risk Of Bias ASsessment Tool (PROBAST)

Ype de Jong, Chava L. Ramspek, Carmine Zoccali, Kitty J. Jager, Friedo Wilhelm Dekker, Merel van Diepen

Nephrology, 26(12), 939–947 · Published 17 June 2021 · DOI 10.1111/nep.13913

Free PDFView at the publisherCite this paper

In brief

“Appraising prediction research: a guide and meta‐review on bias and applicability assessment using the Prediction model Risk Of Bias ASsessment Tool (PROBAST)” is a 2021 journal article by Ype de Jong and 5 co-authors, published in Nephrology. OpenAlex counts 75 citations as of 15 November 2026, which puts it in the top 7% of works published in 2021 by citations. It is open access under a CC BY-NC licence: the full text is free to read at Nephrology.

Citations
75
Most cited in
2026 (21)
Field-weighted impact
3.80
References
12
Authors
6

Abstract

Over the past few years, a large number of prediction models have been published, often of poor methodological quality. Seemingly objective and straightforward, prediction models provide a risk estimate for the outcome of interest, usually based on readily available clinical information. Yet, using models of substandard methodological rigour, especially without external validation, may result in incorrect risk estimates and consequently misclassification. To assess and combat bias in prediction research the prediction model risk of bias assessment tool (PROBAST) was published in 2019. This risk of bias (ROB) tool includes four domains and 20 signalling questions highlighting methodological flaws, and provides guidance in assessing the applicability of the model. In this paper, the PROBAST will be discussed, along with an in-depth review of two commonly encountered pitfalls in prediction modelling that may induce bias: overfitting and composite endpoints. We illustrate the prevalence of potential bias in prediction models with a meta-review of 50 systematic reviews that used the PROBAST to appraise their included studies, thus including 1510 different studies on 2104 prediction models. All domains showed an unclear or high ROB; these results were markedly stable over time, highlighting the urgent need for attention on bias in prediction research. This article aims to do just that by providing (1) the clinician with tools to evaluate the (methodological) quality of a clinical prediction model, (2) the researcher working on a review with methods to appraise the included models, and (3) the researcher developing a model with suggestions to improve model quality.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

de Jong, Y., Ramspek, C. L., Zoccali, C., Jager, K. J., Dekker, F. W., & van Diepen, M. (2021). Appraising prediction research: a guide and meta‐review on bias and applicability assessment using the Prediction model Risk Of Bias ASsessment Tool (PROBAST). Nephrology, 26(12), 939–947. https://doi.org/10.1111/nep.13913

MLA 9

de Jong, Ype, et al. “Appraising prediction research: a guide and meta‐review on bias and applicability assessment using the Prediction model Risk Of Bias ASsessment Tool (PROBAST).” Nephrology, vol. 26, no. 12, 2021, pp. 939–947. https://doi.org/10.1111/nep.13913.

Chicago

de Jong, Ype, Chava L. Ramspek, Carmine Zoccali, Kitty J. Jager, Friedo Wilhelm Dekker, and Merel van Diepen. 2021. “Appraising prediction research: a guide and meta‐review on bias and applicability assessment using the Prediction model Risk Of Bias ASsessment Tool (PROBAST).” Nephrology 26 (12): 939–947. https://doi.org/10.1111/nep.13913.

Harvard

de Jong, Y. et al. (2021) ‘Appraising prediction research: a guide and meta‐review on bias and applicability assessment using the Prediction model Risk Of Bias ASsessment Tool (PROBAST)’, Nephrology, 26(12), pp. 939–947. doi:10.1111/nep.13913.

IEEE

Y. de Jong, C. L. Ramspek, C. Zoccali, K. J. Jager, F. W. Dekker, and M. van Diepen, “Appraising prediction research: a guide and meta‐review on bias and applicability assessment using the Prediction model Risk Of Bias ASsessment Tool (PROBAST),” Nephrology, vol. 26, no. 12, pp. 939–947, 2021, doi: 10.1111/nep.13913.

BibTeX

@article{dejong2021appraising,
  title     = {{Appraising prediction research: a guide and meta‐review on bias and applicability assessment using the Prediction model Risk Of Bias ASsessment Tool (PROBAST)}},
  author    = {de Jong, Ype and Ramspek, Chava L. and Zoccali, Carmine and Jager, Kitty J. and Dekker, Friedo Wilhelm and van Diepen, Merel},
  journal   = {Nephrology},
  year      = {2021},
  volume    = {26},
  number    = {12},
  pages     = {939--947},
  doi       = {10.1111/nep.13913},
  url       = {https://doi.org/10.1111/nep.13913}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202122
20221111
20231313
20241616
20251212
20262121

Its field-weighted citation impact is 3.80: it has been cited 3.80 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews

  • PROBAST
  • risk of bias assessment
  • prediction model
  • clinical prediction model
  • methodological quality
  • overfitting
  • composite endpoints
  • external validation

Work with this paper

Most-cited papers in Decision Sciences

All highly cited Decision Sciences papers

Questions about this paper

How do I cite this paper in APA style?

de Jong, Y., Ramspek, C. L., Zoccali, C., Jager, K. J., Dekker, F. W., & van Diepen, M. (2021). Appraising prediction research: a guide and meta‐review on bias and applicability assessment using the Prediction model Risk Of Bias ASsessment Tool (PROBAST). Nephrology, 26(12), 939–947. https://doi.org/10.1111/nep.13913

How many times has this paper been cited?

75 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at Nephrology.

Who wrote this paper?

Ype de Jong, Chava L. Ramspek, Carmine Zoccali, Kitty J. Jager, Friedo Wilhelm Dekker, Merel van Diepen.

What is the DOI of this paper?

10.1111/nep.13913. The permanent link is https://doi.org/10.1111/nep.13913.

Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.