Journal article · 2024 · Open access
Don't be misled: 3 misconceptions about external validation of clinical prediction models
Journal of Clinical Epidemiology, 172, 111387 · Published 8 May 2024 · DOI 10.1016/j.jclinepi.2024.111387
In brief
“Don't be misled: 3 misconceptions about external validation of clinical prediction models” is a 2024 journal article by Hannah M la Roi-Teeuw and 14 co-authors, published in Journal of Clinical Epidemiology. OpenAlex counts 60 citations as of 15 November 2026, which puts it in the top 2% of works published in 2024 by citations. It is open access under a CC BY licence: the full text is free to read at Journal of Clinical Epidemiology.
- Citations
- 60
- Most cited in
- 2026 (33)
- Field-weighted impact
- 14.47
- References
- 26
- Authors
- 15
Abstract
Clinical prediction models provide risks of health outcomes that can inform patients and support medical decisions. However, most models never make it to actual implementation in practice. A commonly heard reason for this lack of implementation is that prediction models are often not externally validated. While we generally encourage external validation, we argue that an external validation is often neither sufficient nor required as an essential step before implementation. As such, any available external validation should not be perceived as a license for model implementation. We clarify this argument by discussing 3 common misconceptions about external validation. We argue that there is not one type of recommended validation design, not always a necessity for external validation, and sometimes a need for multiple external validations. The insights from this paper can help readers to consider, design, interpret, and appreciate external validation studies.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
la Roi-Teeuw, H. M., van Royen, F. S.-A., de Hond, A., Zahra, A., de Vries, S., Bartels, R., Carriero, A., van Doorn, S., Dunias, Z. S., Kant, I. M., Leeuwenberg, T., Peters, R., Veerhoek, L., van Smeden, M., & Luijken, K. (2024). Don't be misled: 3 misconceptions about external validation of clinical prediction models. Journal of Clinical Epidemiology, 172, 111387. https://doi.org/10.1016/j.jclinepi.2024.111387
MLA 9
la Roi-Teeuw, Hannah M, et al. “Don't be misled: 3 misconceptions about external validation of clinical prediction models.” Journal of Clinical Epidemiology, vol. 172, 2024, p. 111387. https://doi.org/10.1016/j.jclinepi.2024.111387.
Chicago
la Roi-Teeuw, Hannah M, Florien Sophie-Anne van Royen, Anne de Hond, Anum Zahra, Sjoerd de Vries, Richard Bartels, Alex Carriero, et al. 2024. “Don't be misled: 3 misconceptions about external validation of clinical prediction models.” Journal of Clinical Epidemiology 172: 111387. https://doi.org/10.1016/j.jclinepi.2024.111387.
Harvard
la Roi-Teeuw, H. M. et al. (2024) ‘Don't be misled: 3 misconceptions about external validation of clinical prediction models’, Journal of Clinical Epidemiology, 172, p. 111387. doi:10.1016/j.jclinepi.2024.111387.
IEEE
H. M. la Roi-Teeuw et al., “Don't be misled: 3 misconceptions about external validation of clinical prediction models,” Journal of Clinical Epidemiology, vol. 172, p. 111387, 2024, doi: 10.1016/j.jclinepi.2024.111387.
BibTeX
@article{laroiteeuw2024misled,
title = {{Don't be misled: 3 misconceptions about external validation of clinical prediction models}},
author = {la Roi-Teeuw, Hannah M and van Royen, Florien Sophie-Anne and de Hond, Anne and Zahra, Anum and de Vries, Sjoerd and Bartels, Richard and Carriero, Alex and van Doorn, Sander and Dunias, Zoë S and Kant, Ilse M.J. and Leeuwenberg, Tuur and Peters, Ruben and Veerhoek, Laura and van Smeden, Maarten and Luijken, Kim},
journal = {Journal of Clinical Epidemiology},
year = {2024},
volume = {172},
pages = {111387},
doi = {10.1016/j.jclinepi.2024.111387},
url = {https://doi.org/10.1016/j.jclinepi.2024.111387}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2024 | 8 | |
| 2025 | 19 | |
| 2026 | 33 |
Its field-weighted citation impact is 14.47: it has been cited 14.47 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- external validation
- clinical prediction model
- model implementation
- misconceptions
- risk prediction
Work with this paper
Most-cited papers in Mathematics
- Random ForestsLeo Breiman · Machine Learning · 2001 · 142,830 citations
- Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple TestingYoav Benjamini, Yosef Hochberg · Journal of the Royal Statistical Society Series B (Statistical Methodology) · 1995 · 113,923 citations
- Fitting Linear Mixed-Effects Models Using lme4Douglas M. Bates, Martin Maechler, Benjamin M. Bolker and 1 more · Journal of Statistical Software · 2015 · 100,328 citations
- The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations.Reuben M. Baron, David A. Kenny · Journal of Personality and Social Psychology · 1986 · 95,866 citations
- Using multivariate statisticsBarbara Gerson Tabachnick, Linda S. Fidell · 1983 · 79,867 citations
Questions about this paper
How do I cite this paper in APA style?
la Roi-Teeuw, H. M., van Royen, F. S.-A., de Hond, A., Zahra, A., de Vries, S., Bartels, R., Carriero, A., van Doorn, S., Dunias, Z. S., Kant, I. M., Leeuwenberg, T., Peters, R., Veerhoek, L., van Smeden, M., & Luijken, K. (2024). Don't be misled: 3 misconceptions about external validation of clinical prediction models. Journal of Clinical Epidemiology, 172, 111387. https://doi.org/10.1016/j.jclinepi.2024.111387
How many times has this paper been cited?
60 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text at Journal of Clinical Epidemiology.
Who wrote this paper?
Hannah M la Roi-Teeuw, Florien Sophie-Anne van Royen, Anne de Hond, Anum Zahra, Sjoerd de Vries, Richard Bartels, Alex Carriero, Sander van Doorn, Zoë S Dunias, Ilse M.J. Kant, Tuur Leeuwenberg, Ruben Peters and 3 more.
What is the DOI of this paper?
10.1016/j.jclinepi.2024.111387. The permanent link is https://doi.org/10.1016/j.jclinepi.2024.111387.
Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.