Journal article · 2024 · Open access
Evaluating Comprehensibility of 157 Patient-Reported Outcome Measures (PROMs) in the Nationwide Dutch Outcome-Based Healthcare Program: More Attention for Comprehensibility of PROMs is Needed
Patient, 18(1), 65–76 · Published 13 August 2024 · DOI 10.1007/s40271-024-00710-w
In brief
“Evaluating Comprehensibility of 157 Patient-Reported Outcome Measures (PROMs) in the Nationwide Dutch Outcome-Based Healthcare Program: More Attention for Comprehensibility of PROMs is Needed” is a 2024 journal article by Attie Tuinenburg and 10 co-authors, published in Patient. OpenAlex counts 11 citations as of 22 November 2026, which puts it in the top 8% of works published in 2024 by citations. It is open access under a CC BY-NC licence: the full text is free to read at Patient.
- Citations
- 11
- Most cited in
- 2026 (9)
- Field-weighted impact
- 3.25
- References
- 68
- Authors
- 11
Abstract
INTRODUCTION: Patient-reported outcomes measures (PROMs) are increasingly prevalent in healthcare and used for shared decision-making and healthcare quality evaluation. However, the extent to which patients with varying health literacy levels can complete PROMs is often overlooked. This may lead to biased aggregated data and patients being excluded from studies or other PROM collection initiatives. This cross-sectional study evaluates the comprehensibility of 157 well-known and widely used PROM scales using a comprehensibility checklist. METHODS: Pairs of two independent raters scored 157 PROM scales designed for adults included in the 35 sets of outcome information developed as part of the Dutch Outcome-Based Healthcare Program. The PROM scales were scored on the eight comprehensibility domains of the Pharos Checklist for Questionnaires in Healthcare (PCQH). Interrater agreement of domain ratings was assessed using Intraclass Correlation Coefficients or Cohen's kappa. Subsequently, final ratings were established through discussion and used to evaluate the domain-specific comprehensibility rating for each PROM scale. RESULTS: Comprehensibility of a large number of PROM scales (n = 157), which cover a wide range of diseases and conditions across Dutch medical specialist care, was assessed. While most PROM scales were written at an accessible language level, with minimal use of medical terms, instruction clarity, number of questions, and response options emerged as significant issues, affecting a substantial proportion of PROM scales. Interrater agreement was high for most domains of the PCQH. CONCLUSION: This study highlights the need for greater attention to the comprehensibility of PROMs to ensure their accessibility to all patients, including those with low health literacy. The PCQH can be a valuable tool in PROM development in addition to qualitative methods and in selection processes enabling comparison of comprehensibility between PROMs. However, the PCQH needs further development and validation for these purposes. Enhancing the comprehensibility of PROMs is essential for their effective incorporation in healthcare evaluation and decision-making processes.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Tuinenburg, A., Determann, D., Quik, E. H., van der Willik, E. M., Hofstra, G., Hallegraeff, J. M., Vriend, I. I., Warmerdam, L., van Bommel, H. E., Boland, G., & Voshaar, M. A. H. O. (2024). Evaluating Comprehensibility of 157 Patient-Reported Outcome Measures (PROMs) in the Nationwide Dutch Outcome-Based Healthcare Program: More Attention for Comprehensibility of PROMs is Needed. Patient, 18(1), 65–76. https://doi.org/10.1007/s40271-024-00710-w
MLA 9
Tuinenburg, Attie, et al. “Evaluating Comprehensibility of 157 Patient-Reported Outcome Measures (PROMs) in the Nationwide Dutch Outcome-Based Healthcare Program: More Attention for Comprehensibility of PROMs is Needed.” Patient, vol. 18, no. 1, 2024, pp. 65–76. https://doi.org/10.1007/s40271-024-00710-w.
Chicago
Tuinenburg, Attie, Domino Determann, Elise H. Quik, Esmee M. van der Willik, Geeske Hofstra, Joannes M. Hallegraeff, Ingrid I Vriend, et al. 2024. “Evaluating Comprehensibility of 157 Patient-Reported Outcome Measures (PROMs) in the Nationwide Dutch Outcome-Based Healthcare Program: More Attention for Comprehensibility of PROMs is Needed.” Patient 18 (1): 65–76. https://doi.org/10.1007/s40271-024-00710-w.
Harvard
Tuinenburg, A. et al. (2024) ‘Evaluating Comprehensibility of 157 Patient-Reported Outcome Measures (PROMs) in the Nationwide Dutch Outcome-Based Healthcare Program: More Attention for Comprehensibility of PROMs is Needed’, Patient, 18(1), pp. 65–76. doi:10.1007/s40271-024-00710-w.
IEEE
A. Tuinenburg et al., “Evaluating Comprehensibility of 157 Patient-Reported Outcome Measures (PROMs) in the Nationwide Dutch Outcome-Based Healthcare Program: More Attention for Comprehensibility of PROMs is Needed,” Patient, vol. 18, no. 1, pp. 65–76, 2024, doi: 10.1007/s40271-024-00710-w.
BibTeX
@article{tuinenburg2024evaluating,
title = {{Evaluating Comprehensibility of 157 Patient-Reported Outcome Measures (PROMs) in the Nationwide Dutch Outcome-Based Healthcare Program: More Attention for Comprehensibility of PROMs is Needed}},
author = {Tuinenburg, Attie and Determann, Domino and Quik, Elise H. and van der Willik, Esmee M. and Hofstra, Geeske and Hallegraeff, Joannes M. and Vriend, Ingrid I and Warmerdam, Lisanne and van Bommel, Hester E. and Boland, Gudule and Voshaar, Martijn A. H. Oude},
journal = {Patient},
year = {2024},
volume = {18},
number = {1},
pages = {65--76},
doi = {10.1007/s40271-024-00710-w},
url = {https://doi.org/10.1007/s40271-024-00710-w}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Health Sciences › Health Professions › General Health Professions › Health Literacy and Information Accessibility
- patient-reported outcome measures
- comprehensibility
- health literacy
- response options
- shared decision-making
- quality of care evaluation
- interobserver agreement
Work with this paper
Most-cited papers in Health Professions
- DETERMINATION OF SERUM PROTEINS BY MEANS OF THE BIURET REACTIONAllan Godfrey Gornall, Charles J. Bardawill, Maxima M. David · Journal of Biological Chemistry · 1949 · 16,172 citations
- Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation scienceLaura J. Damschroder, David Clark Aron, Rosalind E. Keith and 3 more · Implementation Science · 2009 · 15,527 citations
- FUNCTIONAL EVALUATION: THE BARTHEL INDEX.FLORENCE I. MAHONEY, DOROTHEA W. BARTHEL · PubMed · 1965 · 15,488 citations
- The Timed “Up & Go”: A Test of Basic Functional Mobility for Frail Elderly PersonsDiane Podsiadlo, Sandra Richardson · Journal of the American Geriatrics Society · 1991 · 15,001 citations
- National Committee for Clinical Laboratory StandardsErika Bruck · PEDIATRICS · 1980 · 14,735 citations
Questions about this paper
How do I cite this paper in APA style?
Tuinenburg, A., Determann, D., Quik, E. H., van der Willik, E. M., Hofstra, G., Hallegraeff, J. M., Vriend, I. I., Warmerdam, L., van Bommel, H. E., Boland, G., & Voshaar, M. A. H. O. (2024). Evaluating Comprehensibility of 157 Patient-Reported Outcome Measures (PROMs) in the Nationwide Dutch Outcome-Based Healthcare Program: More Attention for Comprehensibility of PROMs is Needed. Patient, 18(1), 65–76. https://doi.org/10.1007/s40271-024-00710-w
How many times has this paper been cited?
11 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at Patient: sign in and open the PDF from this page.
Who wrote this paper?
Attie Tuinenburg, Domino Determann, Elise H. Quik, Esmee M. van der Willik, Geeske Hofstra, Joannes M. Hallegraeff, Ingrid I Vriend, Lisanne Warmerdam, Hester E. van Bommel, Gudule Boland, Martijn A. H. Oude Voshaar.
What is the DOI of this paper?
10.1007/s40271-024-00710-w, permanently at https://doi.org/10.1007/s40271-024-00710-w. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.