Journal article · 2019 · Open access
An overview of using qualitative techniques to explore and define estimates of clinically important change on clinical outcome assessments
Journal of Patient-Reported Outcomes, 3(1), 16 · Published 4 March 2019 · DOI 10.1186/s41687-019-0100-y
In brief
“An overview of using qualitative techniques to explore and define estimates of clinically important change on clinical outcome assessments” is a 2019 journal article by Hannah Staunton and 6 co-authors, published in Journal of Patient-Reported Outcomes. OpenAlex counts 97 citations as of 22 November 2026, which puts it in the top 4% of works published in 2019 by citations. It is open access under a CC BY licence: the full text is free to read at Journal of Patient-Reported Outcomes.
- Citations
- 97
- Most cited in
- 2025 (20)
- Field-weighted impact
- 10.67
- References
- 34
- Authors
- 7
Abstract
Establishing meaningful change thresholds for Clinical Outcome Assessments (COA) is critical for score interpretation. While anchor- and distribution-based statistical methods are well-established, qualitative approaches are less frequently used. This commentary summarizes and expands on a symposium presented at the International Society for Quality of Life Research (ISOQOL) 2017 annual conference, which provided an overview of qualitative methods that can be used to support understanding of meaningful change thresholds on COAs. Further published literature and additional examples from multiple disease areas which have also qualitatively explored the concept of meaningful change are presented.Semi-structured interviews conducted independently from a clinical trial, exit interviews conducted in the context of a clinical trial, focus groups, vignettes and the Delphi panel method can be used to obtain data regarding meaningful change thresholds, with advantages and disadvantages to each method. Semi-structured interviews using concept elicitation (CE) or cognitive debriefing (CD) methods conducted independently from a clinical trial can be an efficient way to gain in-depth patient/caregiver insights. However, there can be challenges with reconciling heterogeneous data across diverse samples and in interpreting the qualitative insights in the context of quantitative score changes. Semi-structured qualitative interviews using CE/CD methods embedded as exit interviews in a clinical trial context with patients/caregivers can provide insights which can augment quantitative findings based on analysis of clinical trial data. However, there are logistical challenges relating to embedding the interviews in a clinical trial.Focus groups and the Delphi panel method can be valuable for reaching consensus regarding meaningful change thresholds; however, for face-to-face interactions, social desirability bias can affect responses. Finally, using vignettes and taking a mixed methods approach can aid in achieving consensus on the minimum score change endorsed by respondents as a meaningful improvement/decrement. However, the approach can be cognitively challenging for participants and reaching a consensus is not guaranteed.Anchor- and distribution- based methods remain critical in establishing responder definitions. Nonetheless, qualitative data has the potential to provide complementary support that a certain level of change on the target COA, which has been statistically supported, is truly important and meaningful for the target population.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Staunton, H., Willgoss, T., Nelsen, L. M., Burbridge, C., Sully, K., Rofail, D., & Arbuckle, R. (2019). An overview of using qualitative techniques to explore and define estimates of clinically important change on clinical outcome assessments. Journal of Patient-Reported Outcomes, 3(1), 16. https://doi.org/10.1186/s41687-019-0100-y
MLA 9
Staunton, Hannah, et al. “An overview of using qualitative techniques to explore and define estimates of clinically important change on clinical outcome assessments.” Journal of Patient-Reported Outcomes, vol. 3, no. 1, 2019, p. 16. https://doi.org/10.1186/s41687-019-0100-y.
Chicago
Staunton, Hannah, Tom Willgoss, Linda M. Nelsen, Claire Burbridge, Kate Sully, Diana Rofail, and Rob Arbuckle. 2019. “An overview of using qualitative techniques to explore and define estimates of clinically important change on clinical outcome assessments.” Journal of Patient-Reported Outcomes 3 (1): 16. https://doi.org/10.1186/s41687-019-0100-y.
Harvard
Staunton, H. et al. (2019) ‘An overview of using qualitative techniques to explore and define estimates of clinically important change on clinical outcome assessments’, Journal of Patient-Reported Outcomes, 3(1), p. 16. doi:10.1186/s41687-019-0100-y.
IEEE
H. Staunton et al., “An overview of using qualitative techniques to explore and define estimates of clinically important change on clinical outcome assessments,” Journal of Patient-Reported Outcomes, vol. 3, no. 1, p. 16, 2019, doi: 10.1186/s41687-019-0100-y.
BibTeX
@article{staunton2019overview,
title = {{An overview of using qualitative techniques to explore and define estimates of clinically important change on clinical outcome assessments}},
author = {Staunton, Hannah and Willgoss, Tom and Nelsen, Linda M. and Burbridge, Claire and Sully, Kate and Rofail, Diana and Arbuckle, Rob},
journal = {Journal of Patient-Reported Outcomes},
year = {2019},
volume = {3},
number = {1},
pages = {16},
doi = {10.1186/s41687-019-0100-y},
url = {https://doi.org/10.1186/s41687-019-0100-y}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2020 | 4 | |
| 2021 | 13 | |
| 2022 | 15 | |
| 2023 | 9 | |
| 2024 | 16 | |
| 2025 | 20 | |
| 2026 | 20 |
Its field-weighted citation impact is 10.67: it has been cited 10.67 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Social Sciences › Social Sciences › Sociology and Political Science › Delphi Technique in Research
- clinically important change
- clinical outcome assessment
- meaningful change thresholds
- responder definition
- concept elicitation
- cognitive debriefing
- exit interviews
- vignettes
Work with this paper
Most-cited papers in Social Sciences
- Using thematic analysis in psychologyVirginia Braun, Victoria Clarke · Qualitative Research in Psychology · 2006 · 240,222 citations
- Case Study Research: Design and MethodsRobert K. Yin · 1984 · 81,951 citations
- Three Approaches to Qualitative Content AnalysisHsiu-Fang Hsieh, Sarah Elizabeth Shannon · Qualitative Health Research · 2005 · 49,623 citations
- Qualitative Data Analysis: An Expanded SourcebookMatthew B. Miles, A Michael Huberman · Journal of Environmental Psychology · 1994 · 48,311 citations
- Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groupsAllison Tong, Peter Sainsbury, Jonathan C. Craig · International Journal for Quality in Health Care · 2007 · 45,353 citations
Questions about this paper
How do I cite this paper in APA style?
Staunton, H., Willgoss, T., Nelsen, L. M., Burbridge, C., Sully, K., Rofail, D., & Arbuckle, R. (2019). An overview of using qualitative techniques to explore and define estimates of clinically important change on clinical outcome assessments. Journal of Patient-Reported Outcomes, 3(1), 16. https://doi.org/10.1186/s41687-019-0100-y
How many times has this paper been cited?
97 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at Journal of Patient-Reported Outcomes: sign in and open the full text from this page.
Who wrote this paper?
Hannah Staunton, Tom Willgoss, Linda M. Nelsen, Claire Burbridge, Kate Sully, Diana Rofail, Rob Arbuckle.
What is the DOI of this paper?
10.1186/s41687-019-0100-y, permanently at https://doi.org/10.1186/s41687-019-0100-y. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.