Journal article · 2024 · Open access

Don't be misled: 3 misconceptions about external validation of clinical prediction models

Hannah M la Roi-Teeuw, Florien Sophie-Anne van Royen, Anne de Hond, Anum Zahra, Sjoerd de Vries, Richard Bartels, Alex Carriero, Sander van Doorn, Zoë S Dunias, Ilse M.J. Kant, Tuur Leeuwenberg, Ruben Peters and 3 more

Journal of Clinical Epidemiology, 172, 111387 · Published 8 May 2024 · DOI 10.1016/j.jclinepi.2024.111387

Free PDFView at the publisherCite this paper

In brief

“Don't be misled: 3 misconceptions about external validation of clinical prediction models” is a 2024 journal article by Hannah M la Roi-Teeuw and 14 co-authors, published in Journal of Clinical Epidemiology. OpenAlex counts 60 citations as of 15 November 2026, which puts it in the top 2% of works published in 2024 by citations. It is open access under a CC BY licence: the full text is free to read at Journal of Clinical Epidemiology.

Citations
60
Most cited in
2026 (33)
Field-weighted impact
14.47
References
26
Authors
15

Abstract

Clinical prediction models provide risks of health outcomes that can inform patients and support medical decisions. However, most models never make it to actual implementation in practice. A commonly heard reason for this lack of implementation is that prediction models are often not externally validated. While we generally encourage external validation, we argue that an external validation is often neither sufficient nor required as an essential step before implementation. As such, any available external validation should not be perceived as a license for model implementation. We clarify this argument by discussing 3 common misconceptions about external validation. We argue that there is not one type of recommended validation design, not always a necessity for external validation, and sometimes a need for multiple external validations. The insights from this paper can help readers to consider, design, interpret, and appreciate external validation studies.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

la Roi-Teeuw, H. M., van Royen, F. S.-A., de Hond, A., Zahra, A., de Vries, S., Bartels, R., Carriero, A., van Doorn, S., Dunias, Z. S., Kant, I. M., Leeuwenberg, T., Peters, R., Veerhoek, L., van Smeden, M., & Luijken, K. (2024). Don't be misled: 3 misconceptions about external validation of clinical prediction models. Journal of Clinical Epidemiology, 172, 111387. https://doi.org/10.1016/j.jclinepi.2024.111387

MLA 9

la Roi-Teeuw, Hannah M, et al. “Don't be misled: 3 misconceptions about external validation of clinical prediction models.” Journal of Clinical Epidemiology, vol. 172, 2024, p. 111387. https://doi.org/10.1016/j.jclinepi.2024.111387.

Chicago

la Roi-Teeuw, Hannah M, Florien Sophie-Anne van Royen, Anne de Hond, Anum Zahra, Sjoerd de Vries, Richard Bartels, Alex Carriero, et al. 2024. “Don't be misled: 3 misconceptions about external validation of clinical prediction models.” Journal of Clinical Epidemiology 172: 111387. https://doi.org/10.1016/j.jclinepi.2024.111387.

Harvard

la Roi-Teeuw, H. M. et al. (2024) ‘Don't be misled: 3 misconceptions about external validation of clinical prediction models’, Journal of Clinical Epidemiology, 172, p. 111387. doi:10.1016/j.jclinepi.2024.111387.

IEEE

H. M. la Roi-Teeuw et al., “Don't be misled: 3 misconceptions about external validation of clinical prediction models,” Journal of Clinical Epidemiology, vol. 172, p. 111387, 2024, doi: 10.1016/j.jclinepi.2024.111387.

BibTeX

@article{laroiteeuw2024misled,
  title     = {{Don't be misled: 3 misconceptions about external validation of clinical prediction models}},
  author    = {la Roi-Teeuw, Hannah M and van Royen, Florien Sophie-Anne and de Hond, Anne and Zahra, Anum and de Vries, Sjoerd and Bartels, Richard and Carriero, Alex and van Doorn, Sander and Dunias, Zoë S and Kant, Ilse M.J. and Leeuwenberg, Tuur and Peters, Ruben and Veerhoek, Laura and van Smeden, Maarten and Luijken, Kim},
  journal   = {Journal of Clinical Epidemiology},
  year      = {2024},
  volume    = {172},
  pages     = {111387},
  doi       = {10.1016/j.jclinepi.2024.111387},
  url       = {https://doi.org/10.1016/j.jclinepi.2024.111387}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202488
20251919
20263333

Its field-weighted citation impact is 14.47: it has been cited 14.47 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology

  • external validation
  • clinical prediction model
  • model implementation
  • misconceptions
  • risk prediction

Work with this paper

Most-cited papers in Mathematics

All highly cited Mathematics papers

Questions about this paper

How do I cite this paper in APA style?

la Roi-Teeuw, H. M., van Royen, F. S.-A., de Hond, A., Zahra, A., de Vries, S., Bartels, R., Carriero, A., van Doorn, S., Dunias, Z. S., Kant, I. M., Leeuwenberg, T., Peters, R., Veerhoek, L., van Smeden, M., & Luijken, K. (2024). Don't be misled: 3 misconceptions about external validation of clinical prediction models. Journal of Clinical Epidemiology, 172, 111387. https://doi.org/10.1016/j.jclinepi.2024.111387

How many times has this paper been cited?

60 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at Journal of Clinical Epidemiology.

Who wrote this paper?

Hannah M la Roi-Teeuw, Florien Sophie-Anne van Royen, Anne de Hond, Anum Zahra, Sjoerd de Vries, Richard Bartels, Alex Carriero, Sander van Doorn, Zoë S Dunias, Ilse M.J. Kant, Tuur Leeuwenberg, Ruben Peters and 3 more.

What is the DOI of this paper?

10.1016/j.jclinepi.2024.111387. The permanent link is https://doi.org/10.1016/j.jclinepi.2024.111387.

Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.