Journal article · 2024 · Open access

Evaluating Comprehensibility of 157 Patient-Reported Outcome Measures (PROMs) in the Nationwide Dutch Outcome-Based Healthcare Program: More Attention for Comprehensibility of PROMs is Needed

Attie Tuinenburg, Domino Determann, Elise H. Quik, Esmee M. van der Willik, Geeske Hofstra, Joannes M. Hallegraeff, Ingrid I Vriend, Lisanne Warmerdam, Hester E. van Bommel, Gudule Boland, Martijn A. H. Oude Voshaar

Patient, 18(1), 65–76 · Published 13 August 2024 · DOI 10.1007/s40271-024-00710-w

Open PDFView at the publisherCite this paper

In brief

“Evaluating Comprehensibility of 157 Patient-Reported Outcome Measures (PROMs) in the Nationwide Dutch Outcome-Based Healthcare Program: More Attention for Comprehensibility of PROMs is Needed” is a 2024 journal article by Attie Tuinenburg and 10 co-authors, published in Patient. OpenAlex counts 11 citations as of 22 November 2026, which puts it in the top 8% of works published in 2024 by citations. It is open access under a CC BY-NC licence: the full text is free to read at Patient.

Citations
11
Most cited in
2026 (9)
Field-weighted impact
3.25
References
68
Authors
11

Abstract

INTRODUCTION: Patient-reported outcomes measures (PROMs) are increasingly prevalent in healthcare and used for shared decision-making and healthcare quality evaluation. However, the extent to which patients with varying health literacy levels can complete PROMs is often overlooked. This may lead to biased aggregated data and patients being excluded from studies or other PROM collection initiatives. This cross-sectional study evaluates the comprehensibility of 157 well-known and widely used PROM scales using a comprehensibility checklist. METHODS: Pairs of two independent raters scored 157 PROM scales designed for adults included in the 35 sets of outcome information developed as part of the Dutch Outcome-Based Healthcare Program. The PROM scales were scored on the eight comprehensibility domains of the Pharos Checklist for Questionnaires in Healthcare (PCQH). Interrater agreement of domain ratings was assessed using Intraclass Correlation Coefficients or Cohen's kappa. Subsequently, final ratings were established through discussion and used to evaluate the domain-specific comprehensibility rating for each PROM scale. RESULTS: Comprehensibility of a large number of PROM scales (n = 157), which cover a wide range of diseases and conditions across Dutch medical specialist care, was assessed. While most PROM scales were written at an accessible language level, with minimal use of medical terms, instruction clarity, number of questions, and response options emerged as significant issues, affecting a substantial proportion of PROM scales. Interrater agreement was high for most domains of the PCQH. CONCLUSION: This study highlights the need for greater attention to the comprehensibility of PROMs to ensure their accessibility to all patients, including those with low health literacy. The PCQH can be a valuable tool in PROM development in addition to qualitative methods and in selection processes enabling comparison of comprehensibility between PROMs. However, the PCQH needs further development and validation for these purposes. Enhancing the comprehensibility of PROMs is essential for their effective incorporation in healthcare evaluation and decision-making processes.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Tuinenburg, A., Determann, D., Quik, E. H., van der Willik, E. M., Hofstra, G., Hallegraeff, J. M., Vriend, I. I., Warmerdam, L., van Bommel, H. E., Boland, G., & Voshaar, M. A. H. O. (2024). Evaluating Comprehensibility of 157 Patient-Reported Outcome Measures (PROMs) in the Nationwide Dutch Outcome-Based Healthcare Program: More Attention for Comprehensibility of PROMs is Needed. Patient, 18(1), 65–76. https://doi.org/10.1007/s40271-024-00710-w

MLA 9

Tuinenburg, Attie, et al. “Evaluating Comprehensibility of 157 Patient-Reported Outcome Measures (PROMs) in the Nationwide Dutch Outcome-Based Healthcare Program: More Attention for Comprehensibility of PROMs is Needed.” Patient, vol. 18, no. 1, 2024, pp. 65–76. https://doi.org/10.1007/s40271-024-00710-w.

Chicago

Tuinenburg, Attie, Domino Determann, Elise H. Quik, Esmee M. van der Willik, Geeske Hofstra, Joannes M. Hallegraeff, Ingrid I Vriend, et al. 2024. “Evaluating Comprehensibility of 157 Patient-Reported Outcome Measures (PROMs) in the Nationwide Dutch Outcome-Based Healthcare Program: More Attention for Comprehensibility of PROMs is Needed.” Patient 18 (1): 65–76. https://doi.org/10.1007/s40271-024-00710-w.

Harvard

Tuinenburg, A. et al. (2024) ‘Evaluating Comprehensibility of 157 Patient-Reported Outcome Measures (PROMs) in the Nationwide Dutch Outcome-Based Healthcare Program: More Attention for Comprehensibility of PROMs is Needed’, Patient, 18(1), pp. 65–76. doi:10.1007/s40271-024-00710-w.

IEEE

A. Tuinenburg et al., “Evaluating Comprehensibility of 157 Patient-Reported Outcome Measures (PROMs) in the Nationwide Dutch Outcome-Based Healthcare Program: More Attention for Comprehensibility of PROMs is Needed,” Patient, vol. 18, no. 1, pp. 65–76, 2024, doi: 10.1007/s40271-024-00710-w.

BibTeX

@article{tuinenburg2024evaluating,
  title     = {{Evaluating Comprehensibility of 157 Patient-Reported Outcome Measures (PROMs) in the Nationwide Dutch Outcome-Based Healthcare Program: More Attention for Comprehensibility of PROMs is Needed}},
  author    = {Tuinenburg, Attie and Determann, Domino and Quik, Elise H. and van der Willik, Esmee M. and Hofstra, Geeske and Hallegraeff, Joannes M. and Vriend, Ingrid I and Warmerdam, Lisanne and van Bommel, Hester E. and Boland, Gudule and Voshaar, Martijn A. H. Oude},
  journal   = {Patient},
  year      = {2024},
  volume    = {18},
  number    = {1},
  pages     = {65--76},
  doi       = {10.1007/s40271-024-00710-w},
  url       = {https://doi.org/10.1007/s40271-024-00710-w}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Health Sciences › Health Professions › General Health Professions › Health Literacy and Information Accessibility

  • patient-reported outcome measures
  • comprehensibility
  • health literacy
  • response options
  • shared decision-making
  • quality of care evaluation
  • interobserver agreement

Work with this paper

Most-cited papers in Health Professions

All highly cited Health Professions papers

Questions about this paper

How do I cite this paper in APA style?

Tuinenburg, A., Determann, D., Quik, E. H., van der Willik, E. M., Hofstra, G., Hallegraeff, J. M., Vriend, I. I., Warmerdam, L., van Bommel, H. E., Boland, G., & Voshaar, M. A. H. O. (2024). Evaluating Comprehensibility of 157 Patient-Reported Outcome Measures (PROMs) in the Nationwide Dutch Outcome-Based Healthcare Program: More Attention for Comprehensibility of PROMs is Needed. Patient, 18(1), 65–76. https://doi.org/10.1007/s40271-024-00710-w

How many times has this paper been cited?

11 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at Patient: sign in and open the PDF from this page.

Who wrote this paper?

Attie Tuinenburg, Domino Determann, Elise H. Quik, Esmee M. van der Willik, Geeske Hofstra, Joannes M. Hallegraeff, Ingrid I Vriend, Lisanne Warmerdam, Hester E. van Bommel, Gudule Boland, Martijn A. H. Oude Voshaar.

What is the DOI of this paper?

10.1007/s40271-024-00710-w, permanently at https://doi.org/10.1007/s40271-024-00710-w. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.