Journal article · 2018 · Open access
COSMIN methodology for evaluating the content validity of patient-reported outcome measures: a Delphi study
Quality of Life Research, 27(5), 1159–1170 · Published 17 March 2018 · DOI 10.1007/s11136-018-1829-0
In brief
“COSMIN methodology for evaluating the content validity of patient-reported outcome measures: a Delphi study” is a 2018 journal article by Caroline Barbara Terwee and 8 co-authors, published in Quality of Life Research. OpenAlex counts 2,825 citations as of 22 November 2026. It is open access under a CC BY licence: the full text is free to read at Quality of Life Research.
- Citations
- 2,825
- Most cited in
- 2026 (634)
- Field-weighted impact
- 195.66
- References
- 41
- Authors
- 9
Abstract
BACKGROUND: Content validity is the most important measurement property of a patient-reported outcome measure (PROM) and the most challenging to assess. Our aims were to: (1) develop standards for evaluating the quality of PROM development; (2) update the original COSMIN standards for assessing the quality of content validity studies of PROMs; (3) develop criteria for what constitutes good content validity of PROMs, and (4) develop a rating system for summarizing the evidence on a PROM's content validity and grading the quality of the evidence in systematic reviews of PROMs. METHODS: An online 4-round Delphi study was performed among 159 experts from 21 countries. Panelists rated the degree to which they (dis)agreed to proposed standards, criteria, and rating issues on 5-point rating scales ('strongly disagree' to 'strongly agree'), and provided arguments for their ratings. RESULTS: Discussion focused on sample size requirements, recording and field notes, transcribing cognitive interviews, and data coding. After four rounds, the required 67% consensus was reached on all standards, criteria, and rating issues. After pilot-testing, the steering committee made some final changes. Ten criteria for good content validity were defined regarding item relevance, appropriateness of response options and recall period, comprehensiveness, and comprehensibility of the PROM. DISCUSSION: The consensus-based COSMIN methodology for content validity is more detailed, standardized, and transparent than earlier published guidelines, including the previous COSMIN standards. This methodology can contribute to the selection and use of high-quality PROMs in research and clinical practice.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Terwee, C. B., Prinsen, C., Chiarotto, A., Westerman, M. J., Patrick, D. L., Alonso, J., Bouter, L., de Vet, H. C. W., & Mokkink, L. B. (2018). COSMIN methodology for evaluating the content validity of patient-reported outcome measures: a Delphi study. Quality of Life Research, 27(5), 1159–1170. https://doi.org/10.1007/s11136-018-1829-0
MLA 9
Terwee, Caroline Barbara, et al. “COSMIN methodology for evaluating the content validity of patient-reported outcome measures: a Delphi study.” Quality of Life Research, vol. 27, no. 5, 2018, pp. 1159–1170. https://doi.org/10.1007/s11136-018-1829-0.
Chicago
Terwee, Caroline Barbara, C.A.C. Prinsen, Alessandro Chiarotto, Marjan J. Westerman, Donald L. Patrick, Jordi Alonso, L.M. Bouter, Henrica C. W. de Vet, and Lidwine Brigitta Mokkink. 2018. “COSMIN methodology for evaluating the content validity of patient-reported outcome measures: a Delphi study.” Quality of Life Research 27 (5): 1159–1170. https://doi.org/10.1007/s11136-018-1829-0.
Harvard
Terwee, C. B. et al. (2018) ‘COSMIN methodology for evaluating the content validity of patient-reported outcome measures: a Delphi study’, Quality of Life Research, 27(5), pp. 1159–1170. doi:10.1007/s11136-018-1829-0.
IEEE
C. B. Terwee et al., “COSMIN methodology for evaluating the content validity of patient-reported outcome measures: a Delphi study,” Quality of Life Research, vol. 27, no. 5, pp. 1159–1170, 2018, doi: 10.1007/s11136-018-1829-0.
BibTeX
@article{terwee2018cosmin,
title = {{COSMIN methodology for evaluating the content validity of patient-reported outcome measures: a Delphi study}},
author = {Terwee, Caroline Barbara and Prinsen, C.A.C. and Chiarotto, Alessandro and Westerman, Marjan J. and Patrick, Donald L. and Alonso, Jordi and Bouter, L.M. and de Vet, Henrica C. W. and Mokkink, Lidwine Brigitta},
journal = {Quality of Life Research},
year = {2018},
volume = {27},
number = {5},
pages = {1159--1170},
doi = {10.1007/s11136-018-1829-0},
url = {https://doi.org/10.1007/s11136-018-1829-0}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2017 | 1 | |
| 2018 | 19 | |
| 2019 | 73 | |
| 2020 | 182 | |
| 2021 | 280 | |
| 2022 | 313 | |
| 2023 | 385 | |
| 2024 | 485 | |
| 2025 | 450 | |
| 2026 | 634 |
Its field-weighted citation impact is 195.66: it has been cited 195.66 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Social Sciences › Social Sciences › Sociology and Political Science › Delphi Technique in Research
- COSMIN
- content validity
- patient-reported outcome measures
- expert consensus
- rating systems
- quality of evidence
- cognitive interviewing
- item comprehensibility
Work with this paper
Most-cited papers in Social Sciences
- Using thematic analysis in psychologyVirginia Braun, Victoria Clarke · Qualitative Research in Psychology · 2006 · 240,222 citations
- Case Study Research: Design and MethodsRobert K. Yin · 1984 · 81,951 citations
- Three Approaches to Qualitative Content AnalysisHsiu-Fang Hsieh, Sarah Elizabeth Shannon · Qualitative Health Research · 2005 · 49,623 citations
- Qualitative Data Analysis: An Expanded SourcebookMatthew B. Miles, A Michael Huberman · Journal of Environmental Psychology · 1994 · 48,311 citations
- Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groupsAllison Tong, Peter Sainsbury, Jonathan C. Craig · International Journal for Quality in Health Care · 2007 · 45,353 citations
Questions about this paper
How do I cite this paper in APA style?
Terwee, C. B., Prinsen, C., Chiarotto, A., Westerman, M. J., Patrick, D. L., Alonso, J., Bouter, L., de Vet, H. C. W., & Mokkink, L. B. (2018). COSMIN methodology for evaluating the content validity of patient-reported outcome measures: a Delphi study. Quality of Life Research, 27(5), 1159–1170. https://doi.org/10.1007/s11136-018-1829-0
How many times has this paper been cited?
2,825 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at Quality of Life Research: sign in and open the PDF from this page.
Who wrote this paper?
Caroline Barbara Terwee, C.A.C. Prinsen, Alessandro Chiarotto, Marjan J. Westerman, Donald L. Patrick, Jordi Alonso, L.M. Bouter, Henrica C. W. de Vet, Lidwine Brigitta Mokkink.
What is the DOI of this paper?
10.1007/s11136-018-1829-0, permanently at https://doi.org/10.1007/s11136-018-1829-0. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.