Journal article · 2023 · Open access
There is no such thing as a validated prediction model
BMC Medicine, 21(1), 70 · Published 24 February 2023 · DOI 10.1186/s12916-023-02779-w
In brief
“There is no such thing as a validated prediction model” is a 2023 journal article by Ben VAN CALSTER and 3 co-authors, published in BMC Medicine. OpenAlex counts 352 citations as of 15 November 2026. It is open access under a CC BY licence: the full text is free to read at BMC Medicine.
- Citations
- 352
- Most cited in
- 2026 (152)
- Field-weighted impact
- 52.19
- References
- 56
- Authors
- 4
Abstract
BACKGROUND: Clinical prediction models should be validated before implementation in clinical practice. But is favorable performance at internal validation or one external validation sufficient to claim that a prediction model works well in the intended clinical context? MAIN BODY: We argue to the contrary because (1) patient populations vary, (2) measurement procedures vary, and (3) populations and measurements change over time. Hence, we have to expect heterogeneity in model performance between locations and settings, and across time. It follows that prediction models are never truly validated. This does not imply that validation is not important. Rather, the current focus on developing new models should shift to a focus on more extensive, well-conducted, and well-reported validation studies of promising models. CONCLUSION: Principled validation strategies are needed to understand and quantify heterogeneity, monitor performance over time, and update prediction models when appropriate. Such strategies will help to ensure that prediction models stay up-to-date and safe to support clinical decision-making.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
VAN CALSTER, B., Steyerberg, E. W., Wynants, L., & van Smeden, M. (2023). There is no such thing as a validated prediction model. BMC Medicine, 21(1), 70. https://doi.org/10.1186/s12916-023-02779-w
MLA 9
VAN CALSTER, Ben, et al. “There is no such thing as a validated prediction model.” BMC Medicine, vol. 21, no. 1, 2023, p. 70. https://doi.org/10.1186/s12916-023-02779-w.
Chicago
VAN CALSTER, Ben, Ewout Willem Steyerberg, Laure Wynants, and Maarten van Smeden. 2023. “There is no such thing as a validated prediction model.” BMC Medicine 21 (1): 70. https://doi.org/10.1186/s12916-023-02779-w.
Harvard
VAN CALSTER, B. et al. (2023) ‘There is no such thing as a validated prediction model’, BMC Medicine, 21(1), p. 70. doi:10.1186/s12916-023-02779-w.
IEEE
B. VAN CALSTER, E. W. Steyerberg, L. Wynants, and M. van Smeden, “There is no such thing as a validated prediction model,” BMC Medicine, vol. 21, no. 1, p. 70, 2023, doi: 10.1186/s12916-023-02779-w.
BibTeX
@article{vancalster2023there,
title = {{There is no such thing as a validated prediction model}},
author = {VAN CALSTER, Ben and Steyerberg, Ewout Willem and Wynants, Laure and van Smeden, Maarten},
journal = {BMC Medicine},
year = {2023},
volume = {21},
number = {1},
pages = {70},
doi = {10.1186/s12916-023-02779-w},
url = {https://doi.org/10.1186/s12916-023-02779-w}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2022 | 1 | |
| 2023 | 28 | |
| 2024 | 72 | |
| 2025 | 99 | |
| 2026 | 152 |
Its field-weighted citation impact is 52.19: it has been cited 52.19 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- clinical prediction model
- model validation
- external validation
- internal validation
- model updating
- clinical decision support
Work with this paper
Most-cited papers in Mathematics
- Random ForestsLeo Breiman · Machine Learning · 2001 · 142,830 citations
- Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple TestingYoav Benjamini, Yosef Hochberg · Journal of the Royal Statistical Society Series B (Statistical Methodology) · 1995 · 113,923 citations
- Fitting Linear Mixed-Effects Models Using lme4Douglas M. Bates, Martin Maechler, Benjamin M. Bolker and 1 more · Journal of Statistical Software · 2015 · 100,328 citations
- The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations.Reuben M. Baron, David A. Kenny · Journal of Personality and Social Psychology · 1986 · 95,866 citations
- Using multivariate statisticsBarbara Gerson Tabachnick, Linda S. Fidell · 1983 · 79,867 citations
Questions about this paper
How do I cite this paper in APA style?
VAN CALSTER, B., Steyerberg, E. W., Wynants, L., & van Smeden, M. (2023). There is no such thing as a validated prediction model. BMC Medicine, 21(1), 70. https://doi.org/10.1186/s12916-023-02779-w
How many times has this paper been cited?
352 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text at BMC Medicine.
Who wrote this paper?
Ben VAN CALSTER, Ewout Willem Steyerberg, Laure Wynants, Maarten van Smeden.
What is the DOI of this paper?
10.1186/s12916-023-02779-w. The permanent link is https://doi.org/10.1186/s12916-023-02779-w.
Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.