Journal article · 2021 · Open access
Appraising prediction research: a guide and meta‐review on bias and applicability assessment using the Prediction model Risk Of Bias ASsessment Tool (PROBAST)
Nephrology, 26(12), 939–947 · Published 17 June 2021 · DOI 10.1111/nep.13913
In brief
“Appraising prediction research: a guide and meta‐review on bias and applicability assessment using the Prediction model Risk Of Bias ASsessment Tool (PROBAST)” is a 2021 journal article by Ype de Jong and 5 co-authors, published in Nephrology. OpenAlex counts 75 citations as of 15 November 2026, which puts it in the top 7% of works published in 2021 by citations. It is open access under a CC BY-NC licence: the full text is free to read at Nephrology.
- Citations
- 75
- Most cited in
- 2026 (21)
- Field-weighted impact
- 3.80
- References
- 12
- Authors
- 6
Abstract
Over the past few years, a large number of prediction models have been published, often of poor methodological quality. Seemingly objective and straightforward, prediction models provide a risk estimate for the outcome of interest, usually based on readily available clinical information. Yet, using models of substandard methodological rigour, especially without external validation, may result in incorrect risk estimates and consequently misclassification. To assess and combat bias in prediction research the prediction model risk of bias assessment tool (PROBAST) was published in 2019. This risk of bias (ROB) tool includes four domains and 20 signalling questions highlighting methodological flaws, and provides guidance in assessing the applicability of the model. In this paper, the PROBAST will be discussed, along with an in-depth review of two commonly encountered pitfalls in prediction modelling that may induce bias: overfitting and composite endpoints. We illustrate the prevalence of potential bias in prediction models with a meta-review of 50 systematic reviews that used the PROBAST to appraise their included studies, thus including 1510 different studies on 2104 prediction models. All domains showed an unclear or high ROB; these results were markedly stable over time, highlighting the urgent need for attention on bias in prediction research. This article aims to do just that by providing (1) the clinician with tools to evaluate the (methodological) quality of a clinical prediction model, (2) the researcher working on a review with methods to appraise the included models, and (3) the researcher developing a model with suggestions to improve model quality.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
de Jong, Y., Ramspek, C. L., Zoccali, C., Jager, K. J., Dekker, F. W., & van Diepen, M. (2021). Appraising prediction research: a guide and meta‐review on bias and applicability assessment using the Prediction model Risk Of Bias ASsessment Tool (PROBAST). Nephrology, 26(12), 939–947. https://doi.org/10.1111/nep.13913
MLA 9
de Jong, Ype, et al. “Appraising prediction research: a guide and meta‐review on bias and applicability assessment using the Prediction model Risk Of Bias ASsessment Tool (PROBAST).” Nephrology, vol. 26, no. 12, 2021, pp. 939–947. https://doi.org/10.1111/nep.13913.
Chicago
de Jong, Ype, Chava L. Ramspek, Carmine Zoccali, Kitty J. Jager, Friedo Wilhelm Dekker, and Merel van Diepen. 2021. “Appraising prediction research: a guide and meta‐review on bias and applicability assessment using the Prediction model Risk Of Bias ASsessment Tool (PROBAST).” Nephrology 26 (12): 939–947. https://doi.org/10.1111/nep.13913.
Harvard
de Jong, Y. et al. (2021) ‘Appraising prediction research: a guide and meta‐review on bias and applicability assessment using the Prediction model Risk Of Bias ASsessment Tool (PROBAST)’, Nephrology, 26(12), pp. 939–947. doi:10.1111/nep.13913.
IEEE
Y. de Jong, C. L. Ramspek, C. Zoccali, K. J. Jager, F. W. Dekker, and M. van Diepen, “Appraising prediction research: a guide and meta‐review on bias and applicability assessment using the Prediction model Risk Of Bias ASsessment Tool (PROBAST),” Nephrology, vol. 26, no. 12, pp. 939–947, 2021, doi: 10.1111/nep.13913.
BibTeX
@article{dejong2021appraising,
title = {{Appraising prediction research: a guide and meta‐review on bias and applicability assessment using the Prediction model Risk Of Bias ASsessment Tool (PROBAST)}},
author = {de Jong, Ype and Ramspek, Chava L. and Zoccali, Carmine and Jager, Kitty J. and Dekker, Friedo Wilhelm and van Diepen, Merel},
journal = {Nephrology},
year = {2021},
volume = {26},
number = {12},
pages = {939--947},
doi = {10.1111/nep.13913},
url = {https://doi.org/10.1111/nep.13913}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2021 | 2 | |
| 2022 | 11 | |
| 2023 | 13 | |
| 2024 | 16 | |
| 2025 | 12 | |
| 2026 | 21 |
Its field-weighted citation impact is 3.80: it has been cited 3.80 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- PROBAST
- risk of bias assessment
- prediction model
- clinical prediction model
- methodological quality
- overfitting
- composite endpoints
- external validation
Work with this paper
Most-cited papers in Decision Sciences
- The PRISMA 2020 statement: an updated guideline for reporting systematic reviewsMatthew James Page, Joanne E. McKenzie, Patrick M. Bossuyt and 23 more · BMJ · 2021 · 144,919 citations
- Evaluating Structural Equation Models with Unobservable Variables and Measurement ErrorClaes Fornell, David F. Larcker · Journal of Marketing Research · 1981 · 118,336 citations
- Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternativesLi‐tze Hu, Peter M. Bentler · Structural Equation Modeling A Multidisciplinary Journal · 1999 · 117,461 citations
- Common method biases in behavioral research: A critical review of the literature and recommended remedies.Philip M. Podsakoff, SCOTT B. MACKENZIE, Jeong Yeon Lee and 1 more · Journal of Applied Psychology · 2003 · 89,248 citations
- Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statementDavid Moher, Alessandro Liberati, Jennifer Tetzlaff and 2 more · BMJ · 2009 · 85,524 citations
Questions about this paper
How do I cite this paper in APA style?
de Jong, Y., Ramspek, C. L., Zoccali, C., Jager, K. J., Dekker, F. W., & van Diepen, M. (2021). Appraising prediction research: a guide and meta‐review on bias and applicability assessment using the Prediction model Risk Of Bias ASsessment Tool (PROBAST). Nephrology, 26(12), 939–947. https://doi.org/10.1111/nep.13913
How many times has this paper been cited?
75 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text at Nephrology.
Who wrote this paper?
Ype de Jong, Chava L. Ramspek, Carmine Zoccali, Kitty J. Jager, Friedo Wilhelm Dekker, Merel van Diepen.
What is the DOI of this paper?
10.1111/nep.13913. The permanent link is https://doi.org/10.1111/nep.13913.
Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.