Journal article · 2025 · Open access

A Consistent Lack of Consistency: Definitions, Evidentiary Expectations and Potential Use of Meaningful Change Data in Clinical Outcome Assessments Across Stakeholders. Results from a DIA Working Group Literature Review and Survey

Matthew D. Reaney, Vivian H. Shih, A. Wilson, Bill Byrom, Nenad Medić, Dorothee Oberdhan, Carla M. Mamolo, M. Majumder

Therapeutic Innovation & Regulatory Science, 59(2), 337–348 · Published 10 January 2025 · DOI 10.1007/s43441-024-00739-x

Open PDFView at the publisherCite this paper

In brief

“A Consistent Lack of Consistency: Definitions, Evidentiary Expectations and Potential Use of Meaningful Change Data in Clinical Outcome Assessments Across Stakeholders. Results from a DIA Working Group Literature Review and Survey” is a 2025 journal article by Matthew D. Reaney and 7 co-authors, published in Therapeutic Innovation & Regulatory Science. OpenAlex counts 6 citations as of 22 November 2026, which puts it in the top 8% of works published in 2025 by citations. It is open access under a CC BY licence: the full text is free to read at Therapeutic Innovation & Regulatory Science.

Citations
6
Most cited in
2026 (4)
Field-weighted impact
3.05
References
47
Authors
8

Abstract

BACKGROUND: Clinical outcome assessments (COAs) measure how patients feel or function and can be used to understand which patients experience benefits of treatment and which do not. Interpretation of COA data is influenced by how meaningful change is defined. We aimed to compare how different stakeholders define, assess, and use meaningful change for decisions that impact patients. METHODS: A targeted literature review was undertaken in July 2021 using Medline, Embase, online grey literature search engines, and stakeholder organization websites. Additionally, a stakeholder survey on meaningful change was fielded between March and June 2023. Both quantitative and qualitative methods were used to analyze responses and identify key themes. RESULTS: The literature review resulted in 86 references. These revealed different approaches to define, measure and validate meaningful change. There were 248 survey responses. Many respondents felt the terminology and methods for defining meaningful change are confusing. Respondents also emphasized the importance of distinguishing within-patient and between-group change, and defining meaningfulness from the patient perspective (most patients and caregivers do not share a similar definition of meaningfulness as their healthcare professionals). CONCLUSION: Four key recommendations for defining, establishing, and interpreting meaningful change estimates for COAs are: (1) Be clear on the type of "meaningful change" that is discussed or needed for a COA, (2) Ensure the "patient voice" is informing meaningful change estimates/definitions, (3) Acknowledge that a meaningful change estimate for a COA may differ between populations, diseases, and disease states, and (4) Disseminate data in a way that reduces ambiguity.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Reaney, M. D., Shih, V. H., Wilson, A., Byrom, B., Medić, N., Oberdhan, D., Mamolo, C. M., & Majumder, M. (2025). A Consistent Lack of Consistency: Definitions, Evidentiary Expectations and Potential Use of Meaningful Change Data in Clinical Outcome Assessments Across Stakeholders. Results from a DIA Working Group Literature Review and Survey. Therapeutic Innovation & Regulatory Science, 59(2), 337–348. https://doi.org/10.1007/s43441-024-00739-x

MLA 9

Reaney, Matthew D., et al. “A Consistent Lack of Consistency: Definitions, Evidentiary Expectations and Potential Use of Meaningful Change Data in Clinical Outcome Assessments Across Stakeholders. Results from a DIA Working Group Literature Review and Survey.” Therapeutic Innovation & Regulatory Science, vol. 59, no. 2, 2025, pp. 337–348. https://doi.org/10.1007/s43441-024-00739-x.

Chicago

Reaney, Matthew D., Vivian H. Shih, A. Wilson, Bill Byrom, Nenad Medić, Dorothee Oberdhan, Carla M. Mamolo, and M. Majumder. 2025. “A Consistent Lack of Consistency: Definitions, Evidentiary Expectations and Potential Use of Meaningful Change Data in Clinical Outcome Assessments Across Stakeholders. Results from a DIA Working Group Literature Review and Survey.” Therapeutic Innovation & Regulatory Science 59 (2): 337–348. https://doi.org/10.1007/s43441-024-00739-x.

Harvard

Reaney, M. D. et al. (2025) ‘A Consistent Lack of Consistency: Definitions, Evidentiary Expectations and Potential Use of Meaningful Change Data in Clinical Outcome Assessments Across Stakeholders. Results from a DIA Working Group Literature Review and Survey’, Therapeutic Innovation & Regulatory Science, 59(2), pp. 337–348. doi:10.1007/s43441-024-00739-x.

IEEE

M. D. Reaney et al., “A Consistent Lack of Consistency: Definitions, Evidentiary Expectations and Potential Use of Meaningful Change Data in Clinical Outcome Assessments Across Stakeholders. Results from a DIA Working Group Literature Review and Survey,” Therapeutic Innovation & Regulatory Science, vol. 59, no. 2, pp. 337–348, 2025, doi: 10.1007/s43441-024-00739-x.

BibTeX

@article{reaney2025consistent,
  title     = {{A Consistent Lack of Consistency: Definitions, Evidentiary Expectations and Potential Use of Meaningful Change Data in Clinical Outcome Assessments Across Stakeholders. Results from a DIA Working Group Literature Review and Survey}},
  author    = {Reaney, Matthew D. and Shih, Vivian H. and Wilson, A. and Byrom, Bill and Medić, Nenad and Oberdhan, Dorothee and Mamolo, Carla M. and Majumder, M.},
  journal   = {Therapeutic Innovation \& Regulatory Science},
  year      = {2025},
  volume    = {59},
  number    = {2},
  pages     = {337--348},
  doi       = {10.1007/s43441-024-00739-x},
  url       = {https://doi.org/10.1007/s43441-024-00739-x}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life

  • meaningful change
  • clinical outcome assessment
  • patient-reported outcomes
  • stakeholder perspectives
  • patient voice
  • meaningfulness
  • evidence-based decision making
  • patient and caregiver perspectives

Work with this paper

Most-cited papers in Economics, Econometrics and Finance

All highly cited Economics, Econometrics and Finance papers

Questions about this paper

How do I cite this paper in APA style?

Reaney, M. D., Shih, V. H., Wilson, A., Byrom, B., Medić, N., Oberdhan, D., Mamolo, C. M., & Majumder, M. (2025). A Consistent Lack of Consistency: Definitions, Evidentiary Expectations and Potential Use of Meaningful Change Data in Clinical Outcome Assessments Across Stakeholders. Results from a DIA Working Group Literature Review and Survey. Therapeutic Innovation & Regulatory Science, 59(2), 337–348. https://doi.org/10.1007/s43441-024-00739-x

How many times has this paper been cited?

6 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at Therapeutic Innovation & Regulatory Science: sign in and open the PDF from this page.

Who wrote this paper?

Matthew D. Reaney, Vivian H. Shih, A. Wilson, Bill Byrom, Nenad Medić, Dorothee Oberdhan, Carla M. Mamolo, M. Majumder.

What is the DOI of this paper?

10.1007/s43441-024-00739-x, permanently at https://doi.org/10.1007/s43441-024-00739-x. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.