Journal article · 2023 · Open access

There is no such thing as a validated prediction model

Ben VAN CALSTER, Ewout Willem Steyerberg, Laure Wynants, Maarten van Smeden

BMC Medicine, 21(1), 70 · Published 24 February 2023 · DOI 10.1186/s12916-023-02779-w

Free PDFView at the publisherCite this paper

In brief

“There is no such thing as a validated prediction model” is a 2023 journal article by Ben VAN CALSTER and 3 co-authors, published in BMC Medicine. OpenAlex counts 352 citations as of 15 November 2026. It is open access under a CC BY licence: the full text is free to read at BMC Medicine.

Citations
352
Most cited in
2026 (152)
Field-weighted impact
52.19
References
56
Authors
4

Abstract

BACKGROUND: Clinical prediction models should be validated before implementation in clinical practice. But is favorable performance at internal validation or one external validation sufficient to claim that a prediction model works well in the intended clinical context? MAIN BODY: We argue to the contrary because (1) patient populations vary, (2) measurement procedures vary, and (3) populations and measurements change over time. Hence, we have to expect heterogeneity in model performance between locations and settings, and across time. It follows that prediction models are never truly validated. This does not imply that validation is not important. Rather, the current focus on developing new models should shift to a focus on more extensive, well-conducted, and well-reported validation studies of promising models. CONCLUSION: Principled validation strategies are needed to understand and quantify heterogeneity, monitor performance over time, and update prediction models when appropriate. Such strategies will help to ensure that prediction models stay up-to-date and safe to support clinical decision-making.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

VAN CALSTER, B., Steyerberg, E. W., Wynants, L., & van Smeden, M. (2023). There is no such thing as a validated prediction model. BMC Medicine, 21(1), 70. https://doi.org/10.1186/s12916-023-02779-w

MLA 9

VAN CALSTER, Ben, et al. “There is no such thing as a validated prediction model.” BMC Medicine, vol. 21, no. 1, 2023, p. 70. https://doi.org/10.1186/s12916-023-02779-w.

Chicago

VAN CALSTER, Ben, Ewout Willem Steyerberg, Laure Wynants, and Maarten van Smeden. 2023. “There is no such thing as a validated prediction model.” BMC Medicine 21 (1): 70. https://doi.org/10.1186/s12916-023-02779-w.

Harvard

VAN CALSTER, B. et al. (2023) ‘There is no such thing as a validated prediction model’, BMC Medicine, 21(1), p. 70. doi:10.1186/s12916-023-02779-w.

IEEE

B. VAN CALSTER, E. W. Steyerberg, L. Wynants, and M. van Smeden, “There is no such thing as a validated prediction model,” BMC Medicine, vol. 21, no. 1, p. 70, 2023, doi: 10.1186/s12916-023-02779-w.

BibTeX

@article{vancalster2023there,
  title     = {{There is no such thing as a validated prediction model}},
  author    = {VAN CALSTER, Ben and Steyerberg, Ewout Willem and Wynants, Laure and van Smeden, Maarten},
  journal   = {BMC Medicine},
  year      = {2023},
  volume    = {21},
  number    = {1},
  pages     = {70},
  doi       = {10.1186/s12916-023-02779-w},
  url       = {https://doi.org/10.1186/s12916-023-02779-w}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202211
20232828
20247272
20259999
2026152152

Its field-weighted citation impact is 52.19: it has been cited 52.19 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology

  • clinical prediction model
  • model validation
  • external validation
  • internal validation
  • model updating
  • clinical decision support

Work with this paper

Most-cited papers in Mathematics

All highly cited Mathematics papers

Questions about this paper

How do I cite this paper in APA style?

VAN CALSTER, B., Steyerberg, E. W., Wynants, L., & van Smeden, M. (2023). There is no such thing as a validated prediction model. BMC Medicine, 21(1), 70. https://doi.org/10.1186/s12916-023-02779-w

How many times has this paper been cited?

352 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at BMC Medicine.

Who wrote this paper?

Ben VAN CALSTER, Ewout Willem Steyerberg, Laure Wynants, Maarten van Smeden.

What is the DOI of this paper?

10.1186/s12916-023-02779-w. The permanent link is https://doi.org/10.1186/s12916-023-02779-w.

Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.