Review article · 2019 · Open access

A systematic review of the validity and reliability of patient‐reported experience measures

Claudia F. Bull, Joshua Byrnes, Ruvini Manjula Hettiarachchi, Martin Downes

Health Services Research, 54(5), 1023–1035 · Published 19 June 2019 · DOI 10.1111/1475-6773.13187

Open full textView at the publisherCite this paper

In brief

“A systematic review of the validity and reliability of patient‐reported experience measures” is a 2019 review article by Claudia F. Bull and 3 co-authors, published in Health Services Research. OpenAlex counts 448 citations as of 22 November 2026. It is open access: the full text is free to read at PubMed Central.

Citations
448
Most cited in
2024 (103)
Field-weighted impact
2.99
References
170
Authors
4

Abstract

OBJECTIVES: To identify patient-reported experience measures (PREMs), assess their validity and reliability, and assess any bias in the study design of PREM validity and reliability testing. DATA SOURCES/STUDY SETTING: Articles reporting on PREM development and testing sourced from MEDLINE, CINAHL and Scopus databases up to March 13, 2018. STUDY DESIGN: Systematic review. DATA COLLECTION/EXTRACTION METHODS: Critical appraisal of PREM study design was undertaken using the Appraisal tool for Cross-Sectional Studies (AXIS). Critical appraisal of PREM validity and reliability was undertaken using a revised version of the COSMIN checklist. PRINCIPAL FINDINGS: Eighty-eight PREMs were identified, spanning across four main health care contexts. PREM validity and reliability was supported by appropriate study designs. Internal consistency (n = 58, 65.2 percent), structural validity (n = 49, 55.1 percent), and content validity (n = 34, 38.2 percent) were the most frequently reported validity and reliability tests. CONCLUSIONS: Careful consideration should be given when selecting PREMs, particularly as seven of the 10 validity and reliability criteria were not undertaken in ≥50 percent of the PREMs. Testing PREM responsiveness should be prioritized for the application of PREMs where the end user is measuring change over time. Assessing measurement error/agreement of PREMs is important to understand the clinical relevancy of PREM scores used in a health care evaluation capacity.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Bull, C. F., Byrnes, J., Hettiarachchi, R. M., & Downes, M. (2019). A systematic review of the validity and reliability of patient‐reported experience measures. Health Services Research, 54(5), 1023–1035. https://doi.org/10.1111/1475-6773.13187

MLA 9

Bull, Claudia F., et al. “A systematic review of the validity and reliability of patient‐reported experience measures.” Health Services Research, vol. 54, no. 5, 2019, pp. 1023–1035. https://doi.org/10.1111/1475-6773.13187.

Chicago

Bull, Claudia F., Joshua Byrnes, Ruvini Manjula Hettiarachchi, and Martin Downes. 2019. “A systematic review of the validity and reliability of patient‐reported experience measures.” Health Services Research 54 (5): 1023–1035. https://doi.org/10.1111/1475-6773.13187.

Harvard

Bull, C. F. et al. (2019) ‘A systematic review of the validity and reliability of patient‐reported experience measures’, Health Services Research, 54(5), pp. 1023–1035. doi:10.1111/1475-6773.13187.

IEEE

C. F. Bull, J. Byrnes, R. M. Hettiarachchi, and M. Downes, “A systematic review of the validity and reliability of patient‐reported experience measures,” Health Services Research, vol. 54, no. 5, pp. 1023–1035, 2019, doi: 10.1111/1475-6773.13187.

BibTeX

@article{bull2019systematic,
  title     = {{A systematic review of the validity and reliability of patient‐reported experience measures}},
  author    = {Bull, Claudia F. and Byrnes, Joshua and Hettiarachchi, Ruvini Manjula and Downes, Martin},
  journal   = {Health Services Research},
  year      = {2019},
  volume    = {54},
  number    = {5},
  pages     = {1023--1035},
  doi       = {10.1111/1475-6773.13187},
  url       = {https://doi.org/10.1111/1475-6773.13187}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
201811
201911
20201111
20213030
20225252
20237979
2024103103
20258585
20268686

Its field-weighted citation impact is 2.99: it has been cited 2.99 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Health Sciences › Health Professions › General Health Professions › Patient Satisfaction in Healthcare

  • patient-reported experience measures
  • validity
  • reliability statistics
  • internal consistency
  • structural validity
  • content validity
  • responsiveness
  • measurement error

Work with this paper

Most-cited papers in Health Professions

All highly cited Health Professions papers

Questions about this paper

How do I cite this paper in APA style?

Bull, C. F., Byrnes, J., Hettiarachchi, R. M., & Downes, M. (2019). A systematic review of the validity and reliability of patient‐reported experience measures. Health Services Research, 54(5), 1023–1035. https://doi.org/10.1111/1475-6773.13187

How many times has this paper been cited?

448 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at PubMed Central: sign in and open the full text from this page.

Who wrote this paper?

Claudia F. Bull, Joshua Byrnes, Ruvini Manjula Hettiarachchi, Martin Downes.

What is the DOI of this paper?

10.1111/1475-6773.13187, permanently at https://doi.org/10.1111/1475-6773.13187. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.