Review article · 2019 · Open access
A systematic review of the validity and reliability of patient‐reported experience measures
Health Services Research, 54(5), 1023–1035 · Published 19 June 2019 · DOI 10.1111/1475-6773.13187
In brief
“A systematic review of the validity and reliability of patient‐reported experience measures” is a 2019 review article by Claudia F. Bull and 3 co-authors, published in Health Services Research. OpenAlex counts 448 citations as of 22 November 2026. It is open access: the full text is free to read at PubMed Central.
- Citations
- 448
- Most cited in
- 2024 (103)
- Field-weighted impact
- 2.99
- References
- 170
- Authors
- 4
Abstract
OBJECTIVES: To identify patient-reported experience measures (PREMs), assess their validity and reliability, and assess any bias in the study design of PREM validity and reliability testing. DATA SOURCES/STUDY SETTING: Articles reporting on PREM development and testing sourced from MEDLINE, CINAHL and Scopus databases up to March 13, 2018. STUDY DESIGN: Systematic review. DATA COLLECTION/EXTRACTION METHODS: Critical appraisal of PREM study design was undertaken using the Appraisal tool for Cross-Sectional Studies (AXIS). Critical appraisal of PREM validity and reliability was undertaken using a revised version of the COSMIN checklist. PRINCIPAL FINDINGS: Eighty-eight PREMs were identified, spanning across four main health care contexts. PREM validity and reliability was supported by appropriate study designs. Internal consistency (n = 58, 65.2 percent), structural validity (n = 49, 55.1 percent), and content validity (n = 34, 38.2 percent) were the most frequently reported validity and reliability tests. CONCLUSIONS: Careful consideration should be given when selecting PREMs, particularly as seven of the 10 validity and reliability criteria were not undertaken in ≥50 percent of the PREMs. Testing PREM responsiveness should be prioritized for the application of PREMs where the end user is measuring change over time. Assessing measurement error/agreement of PREMs is important to understand the clinical relevancy of PREM scores used in a health care evaluation capacity.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Bull, C. F., Byrnes, J., Hettiarachchi, R. M., & Downes, M. (2019). A systematic review of the validity and reliability of patient‐reported experience measures. Health Services Research, 54(5), 1023–1035. https://doi.org/10.1111/1475-6773.13187
MLA 9
Bull, Claudia F., et al. “A systematic review of the validity and reliability of patient‐reported experience measures.” Health Services Research, vol. 54, no. 5, 2019, pp. 1023–1035. https://doi.org/10.1111/1475-6773.13187.
Chicago
Bull, Claudia F., Joshua Byrnes, Ruvini Manjula Hettiarachchi, and Martin Downes. 2019. “A systematic review of the validity and reliability of patient‐reported experience measures.” Health Services Research 54 (5): 1023–1035. https://doi.org/10.1111/1475-6773.13187.
Harvard
Bull, C. F. et al. (2019) ‘A systematic review of the validity and reliability of patient‐reported experience measures’, Health Services Research, 54(5), pp. 1023–1035. doi:10.1111/1475-6773.13187.
IEEE
C. F. Bull, J. Byrnes, R. M. Hettiarachchi, and M. Downes, “A systematic review of the validity and reliability of patient‐reported experience measures,” Health Services Research, vol. 54, no. 5, pp. 1023–1035, 2019, doi: 10.1111/1475-6773.13187.
BibTeX
@article{bull2019systematic,
title = {{A systematic review of the validity and reliability of patient‐reported experience measures}},
author = {Bull, Claudia F. and Byrnes, Joshua and Hettiarachchi, Ruvini Manjula and Downes, Martin},
journal = {Health Services Research},
year = {2019},
volume = {54},
number = {5},
pages = {1023--1035},
doi = {10.1111/1475-6773.13187},
url = {https://doi.org/10.1111/1475-6773.13187}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2018 | 1 | |
| 2019 | 1 | |
| 2020 | 11 | |
| 2021 | 30 | |
| 2022 | 52 | |
| 2023 | 79 | |
| 2024 | 103 | |
| 2025 | 85 | |
| 2026 | 86 |
Its field-weighted citation impact is 2.99: it has been cited 2.99 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Health Sciences › Health Professions › General Health Professions › Patient Satisfaction in Healthcare
- patient-reported experience measures
- validity
- reliability statistics
- internal consistency
- structural validity
- content validity
- responsiveness
- measurement error
Work with this paper
Most-cited papers in Health Professions
- DETERMINATION OF SERUM PROTEINS BY MEANS OF THE BIURET REACTIONAllan Godfrey Gornall, Charles J. Bardawill, Maxima M. David · Journal of Biological Chemistry · 1949 · 16,172 citations
- Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation scienceLaura J. Damschroder, David Clark Aron, Rosalind E. Keith and 3 more · Implementation Science · 2009 · 15,527 citations
- FUNCTIONAL EVALUATION: THE BARTHEL INDEX.FLORENCE I. MAHONEY, DOROTHEA W. BARTHEL · PubMed · 1965 · 15,488 citations
- The Timed “Up & Go”: A Test of Basic Functional Mobility for Frail Elderly PersonsDiane Podsiadlo, Sandra Richardson · Journal of the American Geriatrics Society · 1991 · 15,001 citations
- National Committee for Clinical Laboratory StandardsErika Bruck · PEDIATRICS · 1980 · 14,735 citations
Questions about this paper
How do I cite this paper in APA style?
Bull, C. F., Byrnes, J., Hettiarachchi, R. M., & Downes, M. (2019). A systematic review of the validity and reliability of patient‐reported experience measures. Health Services Research, 54(5), 1023–1035. https://doi.org/10.1111/1475-6773.13187
How many times has this paper been cited?
448 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at PubMed Central: sign in and open the full text from this page.
Who wrote this paper?
Claudia F. Bull, Joshua Byrnes, Ruvini Manjula Hettiarachchi, Martin Downes.
What is the DOI of this paper?
10.1111/1475-6773.13187, permanently at https://doi.org/10.1111/1475-6773.13187. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.