Journal article · 2025 · Open access
External validation, impact assessment and clinical utilization of clinical prediction models: a prospective cohort study
Journal of Clinical Epidemiology, 186, 111902 · Published 16 July 2025 · DOI 10.1016/j.jclinepi.2025.111902
In brief
“External validation, impact assessment and clinical utilization of clinical prediction models: a prospective cohort study” is a 2025 journal article by Banafsheh Arshi and 5 co-authors, published in Journal of Clinical Epidemiology. OpenAlex counts 30 citations as of 15 November 2026, which puts it in the top 7% of works published in 2025 by citations. It is open access under a CC BY licence: the full text is free to read at Journal of Clinical Epidemiology.
- Citations
- 30
- Most cited in
- 2026 (28)
- Field-weighted impact
- 15.14
- References
- 32
- Authors
- 6
Abstract
OBJECTIVES: We aimed to assess paths taken by clinical prediction models (CPMs) after development by quantifying external validation, impact assessment, and utilization in clinical practice. STUDY DESIGN AND SETTING: We followed a random sample of 109 regression-based CPM development articles published between 1995 and 2020 by performing a forward citation search. We estimated 5- and 10-year probabilities of validation and impact assessment after development of CPMs using Kaplan-Meier analysis. In addition, we conducted a survey among the authors of the development articles to determine whether the CPMs had been used in clinical settings. RESULTS: Eighteen (17%) CPM development articles reported a CPM that was externally validated after development. Five- and 10-year probabilities of validation were 0.13 (0.06-0.19) and 0.16 (0.08-0.23), respectively. Only 1 article had a CPM with impact assessment during follow-up (10-year probability: 0.01 [0-0.04]). Among the 34 (31%) articles with a survey response, 17 (50%) had CPMs that had been used in clinical practice, in a median of five sites (interquartile range: 1-347). Of these models, only 4 (24%) were externally validated, and none had undergone impact assessment. CONCLUSION: Despite evidence of utilization in clinical settings, few models are externally validated after development, and published impact assessment is scarce. To prevent compromising patient safety, it is crucial to intensify efforts to promote external validation and impact assessment of prediction models.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Arshi, B., Cowley, L., Rijnhart, E., Reeve, K. A., Smits, L. J., & Wynants, L. (2025). External validation, impact assessment and clinical utilization of clinical prediction models: a prospective cohort study. Journal of Clinical Epidemiology, 186, 111902. https://doi.org/10.1016/j.jclinepi.2025.111902
MLA 9
Arshi, Banafsheh, et al. “External validation, impact assessment and clinical utilization of clinical prediction models: a prospective cohort study.” Journal of Clinical Epidemiology, vol. 186, 2025, p. 111902. https://doi.org/10.1016/j.jclinepi.2025.111902.
Chicago
Arshi, Banafsheh, Laura Cowley, Eline Rijnhart, Kelly A. Reeve, Luc J.M. Smits, and Laure Wynants. 2025. “External validation, impact assessment and clinical utilization of clinical prediction models: a prospective cohort study.” Journal of Clinical Epidemiology 186: 111902. https://doi.org/10.1016/j.jclinepi.2025.111902.
Harvard
Arshi, B. et al. (2025) ‘External validation, impact assessment and clinical utilization of clinical prediction models: a prospective cohort study’, Journal of Clinical Epidemiology, 186, p. 111902. doi:10.1016/j.jclinepi.2025.111902.
IEEE
B. Arshi, L. Cowley, E. Rijnhart, K. A. Reeve, L. J. Smits, and L. Wynants, “External validation, impact assessment and clinical utilization of clinical prediction models: a prospective cohort study,” Journal of Clinical Epidemiology, vol. 186, p. 111902, 2025, doi: 10.1016/j.jclinepi.2025.111902.
BibTeX
@article{arshi2025external,
title = {{External validation, impact assessment and clinical utilization of clinical prediction models: a prospective cohort study}},
author = {Arshi, Banafsheh and Cowley, Laura and Rijnhart, Eline and Reeve, Kelly A. and Smits, Luc J.M. and Wynants, Laure},
journal = {Journal of Clinical Epidemiology},
year = {2025},
volume = {186},
pages = {111902},
doi = {10.1016/j.jclinepi.2025.111902},
url = {https://doi.org/10.1016/j.jclinepi.2025.111902}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- clinical prediction model
- external validation
- impact assessment
- clinical utilization
- patient safety
Work with this paper
Most-cited papers in Mathematics
- Random ForestsLeo Breiman · Machine Learning · 2001 · 142,830 citations
- Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple TestingYoav Benjamini, Yosef Hochberg · Journal of the Royal Statistical Society Series B (Statistical Methodology) · 1995 · 113,923 citations
- Fitting Linear Mixed-Effects Models Using lme4Douglas M. Bates, Martin Maechler, Benjamin M. Bolker and 1 more · Journal of Statistical Software · 2015 · 100,328 citations
- The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations.Reuben M. Baron, David A. Kenny · Journal of Personality and Social Psychology · 1986 · 95,866 citations
- Using multivariate statisticsBarbara Gerson Tabachnick, Linda S. Fidell · 1983 · 79,867 citations
Questions about this paper
How do I cite this paper in APA style?
Arshi, B., Cowley, L., Rijnhart, E., Reeve, K. A., Smits, L. J., & Wynants, L. (2025). External validation, impact assessment and clinical utilization of clinical prediction models: a prospective cohort study. Journal of Clinical Epidemiology, 186, 111902. https://doi.org/10.1016/j.jclinepi.2025.111902
How many times has this paper been cited?
30 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text at Journal of Clinical Epidemiology.
Who wrote this paper?
Banafsheh Arshi, Laura Cowley, Eline Rijnhart, Kelly A. Reeve, Luc J.M. Smits, Laure Wynants.
What is the DOI of this paper?
10.1016/j.jclinepi.2025.111902. The permanent link is https://doi.org/10.1016/j.jclinepi.2025.111902.
Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.