Journal article · 2025 · Open access

External validation, impact assessment and clinical utilization of clinical prediction models: a prospective cohort study

Banafsheh Arshi, Laura Cowley, Eline Rijnhart, Kelly A. Reeve, Luc J.M. Smits, Laure Wynants

Journal of Clinical Epidemiology, 186, 111902 · Published 16 July 2025 · DOI 10.1016/j.jclinepi.2025.111902

Read the free full textCite this paper

In brief

“External validation, impact assessment and clinical utilization of clinical prediction models: a prospective cohort study” is a 2025 journal article by Banafsheh Arshi and 5 co-authors, published in Journal of Clinical Epidemiology. OpenAlex counts 30 citations as of 15 November 2026, which puts it in the top 7% of works published in 2025 by citations. It is open access under a CC BY licence: the full text is free to read at Journal of Clinical Epidemiology.

Citations
30
Most cited in
2026 (28)
Field-weighted impact
15.14
References
32
Authors
6

Abstract

OBJECTIVES: We aimed to assess paths taken by clinical prediction models (CPMs) after development by quantifying external validation, impact assessment, and utilization in clinical practice. STUDY DESIGN AND SETTING: We followed a random sample of 109 regression-based CPM development articles published between 1995 and 2020 by performing a forward citation search. We estimated 5- and 10-year probabilities of validation and impact assessment after development of CPMs using Kaplan-Meier analysis. In addition, we conducted a survey among the authors of the development articles to determine whether the CPMs had been used in clinical settings. RESULTS: Eighteen (17%) CPM development articles reported a CPM that was externally validated after development. Five- and 10-year probabilities of validation were 0.13 (0.06-0.19) and 0.16 (0.08-0.23), respectively. Only 1 article had a CPM with impact assessment during follow-up (10-year probability: 0.01 [0-0.04]). Among the 34 (31%) articles with a survey response, 17 (50%) had CPMs that had been used in clinical practice, in a median of five sites (interquartile range: 1-347). Of these models, only 4 (24%) were externally validated, and none had undergone impact assessment. CONCLUSION: Despite evidence of utilization in clinical settings, few models are externally validated after development, and published impact assessment is scarce. To prevent compromising patient safety, it is crucial to intensify efforts to promote external validation and impact assessment of prediction models.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Arshi, B., Cowley, L., Rijnhart, E., Reeve, K. A., Smits, L. J., & Wynants, L. (2025). External validation, impact assessment and clinical utilization of clinical prediction models: a prospective cohort study. Journal of Clinical Epidemiology, 186, 111902. https://doi.org/10.1016/j.jclinepi.2025.111902

MLA 9

Arshi, Banafsheh, et al. “External validation, impact assessment and clinical utilization of clinical prediction models: a prospective cohort study.” Journal of Clinical Epidemiology, vol. 186, 2025, p. 111902. https://doi.org/10.1016/j.jclinepi.2025.111902.

Chicago

Arshi, Banafsheh, Laura Cowley, Eline Rijnhart, Kelly A. Reeve, Luc J.M. Smits, and Laure Wynants. 2025. “External validation, impact assessment and clinical utilization of clinical prediction models: a prospective cohort study.” Journal of Clinical Epidemiology 186: 111902. https://doi.org/10.1016/j.jclinepi.2025.111902.

Harvard

Arshi, B. et al. (2025) ‘External validation, impact assessment and clinical utilization of clinical prediction models: a prospective cohort study’, Journal of Clinical Epidemiology, 186, p. 111902. doi:10.1016/j.jclinepi.2025.111902.

IEEE

B. Arshi, L. Cowley, E. Rijnhart, K. A. Reeve, L. J. Smits, and L. Wynants, “External validation, impact assessment and clinical utilization of clinical prediction models: a prospective cohort study,” Journal of Clinical Epidemiology, vol. 186, p. 111902, 2025, doi: 10.1016/j.jclinepi.2025.111902.

BibTeX

@article{arshi2025external,
  title     = {{External validation, impact assessment and clinical utilization of clinical prediction models: a prospective cohort study}},
  author    = {Arshi, Banafsheh and Cowley, Laura and Rijnhart, Eline and Reeve, Kelly A. and Smits, Luc J.M. and Wynants, Laure},
  journal   = {Journal of Clinical Epidemiology},
  year      = {2025},
  volume    = {186},
  pages     = {111902},
  doi       = {10.1016/j.jclinepi.2025.111902},
  url       = {https://doi.org/10.1016/j.jclinepi.2025.111902}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology

  • clinical prediction model
  • external validation
  • impact assessment
  • clinical utilization
  • patient safety

Work with this paper

Most-cited papers in Mathematics

All highly cited Mathematics papers

Questions about this paper

How do I cite this paper in APA style?

Arshi, B., Cowley, L., Rijnhart, E., Reeve, K. A., Smits, L. J., & Wynants, L. (2025). External validation, impact assessment and clinical utilization of clinical prediction models: a prospective cohort study. Journal of Clinical Epidemiology, 186, 111902. https://doi.org/10.1016/j.jclinepi.2025.111902

How many times has this paper been cited?

30 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at Journal of Clinical Epidemiology.

Who wrote this paper?

Banafsheh Arshi, Laura Cowley, Eline Rijnhart, Kelly A. Reeve, Luc J.M. Smits, Laure Wynants.

What is the DOI of this paper?

10.1016/j.jclinepi.2025.111902. The permanent link is https://doi.org/10.1016/j.jclinepi.2025.111902.

Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.