Journal article · 2023 · Open access
Measuring the performance of prediction models to personalize treatment choice
Statistics in Medicine, 42(8), 1188–1206 · Published 26 January 2023 · DOI 10.1002/sim.9665
In brief
“Measuring the performance of prediction models to personalize treatment choice” is a 2023 journal article by Orestis Efthimiou and 6 co-authors, published in Statistics in Medicine. OpenAlex counts 51 citations as of 15 November 2026, which puts it in the top 2% of works published in 2023 by citations. It is open access under a CC BY licence: the full text is free to read at Statistics in Medicine.
- Citations
- 51
- Most cited in
- 2026 (18)
- Field-weighted impact
- 7.59
- References
- 46
- Authors
- 7
Abstract
When data are available from individual patients receiving either a treatment or a control intervention in a randomized trial, various statistical and machine learning methods can be used to develop models for predicting future outcomes under the two conditions, and thus to predict treatment effect at the patient level. These predictions can subsequently guide personalized treatment choices. Although several methods for validating prediction models are available, little attention has been given to measuring the performance of predictions of personalized treatment effect. In this article, we propose a range of measures that can be used to this end. We start by defining two dimensions of model accuracy for treatment effects, for a single outcome: discrimination for benefit and calibration for benefit. We then amalgamate these two dimensions into an additional concept, decision accuracy, which quantifies the model's ability to identify patients for whom the benefit from treatment exceeds a given threshold. Subsequently, we propose a series of performance measures related to these dimensions and discuss estimating procedures, focusing on randomized data. Our methods are applicable for continuous or binary outcomes, for any type of prediction model, as long as it uses baseline covariates to predict outcomes under treatment and control. We illustrate all methods using two simulated datasets and a real dataset from a trial in depression. We implement all methods in the R package predieval. Results suggest that the proposed measures can be useful in evaluating and comparing the performance of competing models in predicting individualized treatment effect.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Efthimiou, O., Hoogland, J., Debray, T. P. A., Seo, M., Furukawa, T. A., Egger, M., & White, I. R. (2023). Measuring the performance of prediction models to personalize treatment choice. Statistics in Medicine, 42(8), 1188–1206. https://doi.org/10.1002/sim.9665
MLA 9
Efthimiou, Orestis, et al. “Measuring the performance of prediction models to personalize treatment choice.” Statistics in Medicine, vol. 42, no. 8, 2023, pp. 1188–1206. https://doi.org/10.1002/sim.9665.
Chicago
Efthimiou, Orestis, Jeroen Hoogland, Thomas P. A. Debray, Michael Seo, Toshi A. Furukawa, Matthias Egger, and Ian R. White. 2023. “Measuring the performance of prediction models to personalize treatment choice.” Statistics in Medicine 42 (8): 1188–1206. https://doi.org/10.1002/sim.9665.
Harvard
Efthimiou, O. et al. (2023) ‘Measuring the performance of prediction models to personalize treatment choice’, Statistics in Medicine, 42(8), pp. 1188–1206. doi:10.1002/sim.9665.
IEEE
O. Efthimiou et al., “Measuring the performance of prediction models to personalize treatment choice,” Statistics in Medicine, vol. 42, no. 8, pp. 1188–1206, 2023, doi: 10.1002/sim.9665.
BibTeX
@article{efthimiou2023measuring,
title = {{Measuring the performance of prediction models to personalize treatment choice}},
author = {Efthimiou, Orestis and Hoogland, Jeroen and Debray, Thomas P. A. and Seo, Michael and Furukawa, Toshi A. and Egger, Matthias and White, Ian R.},
journal = {Statistics in Medicine},
year = {2023},
volume = {42},
number = {8},
pages = {1188--1206},
doi = {10.1002/sim.9665},
url = {https://doi.org/10.1002/sim.9665}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2023 | 7 | |
| 2024 | 12 | |
| 2025 | 14 | |
| 2026 | 18 |
Its field-weighted citation impact is 7.59: it has been cited 7.59 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- prediction model validation
- individual treatment effects
- decision accuracy
- depression treatment
Work with this paper
Most-cited papers in Mathematics
- Random ForestsLeo Breiman · Machine Learning · 2001 · 142,830 citations
- Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple TestingYoav Benjamini, Yosef Hochberg · Journal of the Royal Statistical Society Series B (Statistical Methodology) · 1995 · 113,923 citations
- Fitting Linear Mixed-Effects Models Using lme4Douglas M. Bates, Martin Maechler, Benjamin M. Bolker and 1 more · Journal of Statistical Software · 2015 · 100,328 citations
- The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations.Reuben M. Baron, David A. Kenny · Journal of Personality and Social Psychology · 1986 · 95,866 citations
- Using multivariate statisticsBarbara Gerson Tabachnick, Linda S. Fidell · 1983 · 79,867 citations
Questions about this paper
How do I cite this paper in APA style?
Efthimiou, O., Hoogland, J., Debray, T. P. A., Seo, M., Furukawa, T. A., Egger, M., & White, I. R. (2023). Measuring the performance of prediction models to personalize treatment choice. Statistics in Medicine, 42(8), 1188–1206. https://doi.org/10.1002/sim.9665
How many times has this paper been cited?
51 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text at Statistics in Medicine.
Who wrote this paper?
Orestis Efthimiou, Jeroen Hoogland, Thomas P. A. Debray, Michael Seo, Toshi A. Furukawa, Matthias Egger, Ian R. White.
What is the DOI of this paper?
10.1002/sim.9665. The permanent link is https://doi.org/10.1002/sim.9665.
Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.