Review article · 2025 · Open access
Implementation and Updating of Clinical Prediction Models: A Systematic Review
Mayo Clinic Proceedings Digital Health, 3(3), 100228 · Published 23 May 2025 · DOI 10.1016/j.mcpdig.2025.100228
In brief
“Implementation and Updating of Clinical Prediction Models: A Systematic Review” is a 2025 review article by Alexander Saelmans and 9 co-authors, published in Mayo Clinic Proceedings Digital Health. OpenAlex counts 53 citations as of 20 November 2026, which puts it in the top 2% of works published in 2025 by citations. It is open access under a CC BY licence: the full text is free to read at Mayo Clinic Proceedings Digital Health.
- Citations
- 53
- Most cited in
- 2026 (46)
- Field-weighted impact
- 5.03
- References
- 69
- Authors
- 10
Abstract
Objective: To summarize the implementation approaches and updating methods of clinically implemented models and consecutively advise researchers on the implementation and updating. Patients and Methods: We included studies describing the implementation of prognostic binary prediction models in a clinical setting. We retrieved articles from Embase, Medline, and Web of Science from January 1, 2010, to January 1, 2024. We performed data extraction, based on Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis and Prediction Model Risk of Bias Assessment guidelines, and summarized. Results: The search yielded 1872 articles. Following screening, 37 articles, describing 56 prediction models, were eligible for inclusion. The overall risk of bias was high in 86% of publications. In model development and internal validation, 32% of the models was assessed for calibration. External validation was performed for 27% of the models. Most models were implemented into the hospital information system (63%), followed by a web application (32%) and a patient decision aid tool (5%). Moreover, 13% of models have been updated following implementation. Conclusion: Impact assessments generally showed successful model implementation and the ability to improve patient care, despite not fully adhering to prediction modeling best practice. Both impact assessment and updating could play a key role in identifying and lowering bias in models.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Saelmans, A., Seinen, T. M., Pera, V., Markus, A. F., Fridgeirsson, E. A., John, L. H., Schiphof‐Godart, L., Rijnbeek, P. R., Reps, J., & Williams, R. D. (2025). Implementation and Updating of Clinical Prediction Models: A Systematic Review. Mayo Clinic Proceedings Digital Health, 3(3), 100228. https://doi.org/10.1016/j.mcpdig.2025.100228
MLA 9
Saelmans, Alexander, et al. “Implementation and Updating of Clinical Prediction Models: A Systematic Review.” Mayo Clinic Proceedings Digital Health, vol. 3, no. 3, 2025, p. 100228. https://doi.org/10.1016/j.mcpdig.2025.100228.
Chicago
Saelmans, Alexander, Tom M Seinen, Victor Pera, Aniek F. Markus, Egill Axfjord Fridgeirsson, Luis H. John, Lieke Schiphof‐Godart, Peter R. Rijnbeek, Jenna Reps, and Ross D. Williams. 2025. “Implementation and Updating of Clinical Prediction Models: A Systematic Review.” Mayo Clinic Proceedings Digital Health 3 (3): 100228. https://doi.org/10.1016/j.mcpdig.2025.100228.
Harvard
Saelmans, A. et al. (2025) ‘Implementation and Updating of Clinical Prediction Models: A Systematic Review’, Mayo Clinic Proceedings Digital Health, 3(3), p. 100228. doi:10.1016/j.mcpdig.2025.100228.
IEEE
A. Saelmans et al., “Implementation and Updating of Clinical Prediction Models: A Systematic Review,” Mayo Clinic Proceedings Digital Health, vol. 3, no. 3, p. 100228, 2025, doi: 10.1016/j.mcpdig.2025.100228.
BibTeX
@article{saelmans2025implementation,
title = {{Implementation and Updating of Clinical Prediction Models: A Systematic Review}},
author = {Saelmans, Alexander and Seinen, Tom M and Pera, Victor and Markus, Aniek F. and Fridgeirsson, Egill Axfjord and John, Luis H. and Schiphof‐Godart, Lieke and Rijnbeek, Peter R. and Reps, Jenna and Williams, Ross D.},
journal = {Mayo Clinic Proceedings Digital Health},
year = {2025},
volume = {3},
number = {3},
pages = {100228},
doi = {10.1016/j.mcpdig.2025.100228},
url = {https://doi.org/10.1016/j.mcpdig.2025.100228}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- clinical prediction model
- model implementation
- model updating
- prognostic model
- hospital information systems
- web application
- patient decision aids
- external validation
Work with this paper
Most-cited papers in Mathematics
- Random ForestsLeo Breiman · Machine Learning · 2001 · 142,830 citations
- Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple TestingYoav Benjamini, Yosef Hochberg · Journal of the Royal Statistical Society Series B (Statistical Methodology) · 1995 · 113,923 citations
- Fitting Linear Mixed-Effects Models Using lme4Douglas M. Bates, Martin Maechler, Benjamin M. Bolker and 1 more · Journal of Statistical Software · 2015 · 100,328 citations
- The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations.Reuben M. Baron, David A. Kenny · Journal of Personality and Social Psychology · 1986 · 95,866 citations
- Using multivariate statisticsBarbara Gerson Tabachnick, Linda S. Fidell · 1983 · 79,867 citations
Questions about this paper
How do I cite this paper in APA style?
Saelmans, A., Seinen, T. M., Pera, V., Markus, A. F., Fridgeirsson, E. A., John, L. H., Schiphof‐Godart, L., Rijnbeek, P. R., Reps, J., & Williams, R. D. (2025). Implementation and Updating of Clinical Prediction Models: A Systematic Review. Mayo Clinic Proceedings Digital Health, 3(3), 100228. https://doi.org/10.1016/j.mcpdig.2025.100228
How many times has this paper been cited?
53 times, according to OpenAlex on 20 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at Mayo Clinic Proceedings Digital Health: sign in and open the PDF from this page.
Who wrote this paper?
Alexander Saelmans, Tom M Seinen, Victor Pera, Aniek F. Markus, Egill Axfjord Fridgeirsson, Luis H. John, Lieke Schiphof‐Godart, Peter R. Rijnbeek, Jenna Reps, Ross D. Williams.
What is the DOI of this paper?
10.1016/j.mcpdig.2025.100228, permanently at https://doi.org/10.1016/j.mcpdig.2025.100228. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 20 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.