Review article · 2020 · Open access
Mind the methods of determining minimal important differences: three critical issues to consider
Evidence-Based Mental Health, 24(2), 77–81 · Published 24 August 2020 · DOI 10.1136/ebmental-2020-300164
In brief
“Mind the methods of determining minimal important differences: three critical issues to consider” is a 2020 review article by Tahira Devji and 2 co-authors, published in Evidence-Based Mental Health. OpenAlex counts 82 citations as of 22 November 2026, which puts it in the top 3% of works published in 2020 by citations. It is open access: the full text is free to read at Evidence-Based Mental Health.
- Citations
- 82
- Most cited in
- 2024 (30)
- Field-weighted impact
- 0.86
- References
- 33
- Authors
- 3
Abstract
OBJECTIVE: Clinical trialists, meta-analysts and clinical guideline developers are increasingly using minimal important differences (MIDs) to enhance the interpretability of patient-reported outcome measures (PROMs). Here, we elucidate three critical issues of which MID users should be aware. Improved understanding of MID concepts and awareness of common pitfalls in methodology and reporting will better inform the application of MIDs in clinical research and decision-making. METHODS: We conducted a systematic review to inform the development of an inventory of anchor-based MID estimates for PROMs. We searched four electronic databases to identify primary studies empirically calculating an anchor-based MID estimate for any PROM in adolescent or adult populations across all clinical areas. Our findings are based on information from 338 studies reporting 3389 MIDs for 358 PROMs published between 1989 and 2015. RESULTS: We identified three key issues in the MID literature that demand attention. (1) The profusion of terms representing the MID concept adds unnecessary complexity to users' task in identifying relevant MIDs, requiring meticulous inspection of methodology to ensure estimates offered truly reflect the MID. (2) A multitude of diverse methods for MID estimation that will yield different estimates exist, and whether there are superior options remains unresolved. (3) There are serious issues of incomplete presentation and reporting of key aspects of the design, methodology and results of studies providing anchor-based MIDs, which threatens the optimal use of these estimates for interpretation of intervention effects on PROMs. CONCLUSIONS: Although the MID represents a powerful tool for enhancing the interpretability of PROMs, realising its full value will require improved understanding and reporting of its measurement fundamentals.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Devji, T., Carrasco‐Labra, A., & Guyatt, G. H. (2020). Mind the methods of determining minimal important differences: three critical issues to consider. Evidence-Based Mental Health, 24(2), 77–81. https://doi.org/10.1136/ebmental-2020-300164
MLA 9
Devji, Tahira, et al. “Mind the methods of determining minimal important differences: three critical issues to consider.” Evidence-Based Mental Health, vol. 24, no. 2, 2020, pp. 77–81. https://doi.org/10.1136/ebmental-2020-300164.
Chicago
Devji, Tahira, Alonso Carrasco‐Labra, and Gordon Henry Guyatt. 2020. “Mind the methods of determining minimal important differences: three critical issues to consider.” Evidence-Based Mental Health 24 (2): 77–81. https://doi.org/10.1136/ebmental-2020-300164.
Harvard
Devji, T., Carrasco‐Labra, A. and Guyatt, G. H. (2020) ‘Mind the methods of determining minimal important differences: three critical issues to consider’, Evidence-Based Mental Health, 24(2), pp. 77–81. doi:10.1136/ebmental-2020-300164.
IEEE
T. Devji, A. Carrasco‐Labra, and G. H. Guyatt, “Mind the methods of determining minimal important differences: three critical issues to consider,” Evidence-Based Mental Health, vol. 24, no. 2, pp. 77–81, 2020, doi: 10.1136/ebmental-2020-300164.
BibTeX
@article{devji2020mind,
title = {{Mind the methods of determining minimal important differences: three critical issues to consider}},
author = {Devji, Tahira and Carrasco‐Labra, Alonso and Guyatt, Gordon Henry},
journal = {Evidence-Based Mental Health},
year = {2020},
volume = {24},
number = {2},
pages = {77--81},
doi = {10.1136/ebmental-2020-300164},
url = {https://doi.org/10.1136/ebmental-2020-300164}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2021 | 5 | |
| 2022 | 13 | |
| 2023 | 10 | |
| 2024 | 30 | |
| 2025 | 9 | |
| 2026 | 15 |
Its field-weighted citation impact is 0.86: it has been cited 0.86 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- minimal important difference
- patient-reported outcome measures
- clinical trial interpretation
Work with this paper
Most-cited papers in Economics, Econometrics and Finance
- Theory of the firm: Managerial behavior, agency costs and ownership structureMichael C. Jensen, William H. Meckling · Journal of Financial Economics · 1976 · 77,585 citations
- Institutions, Institutional Change and Economic PerformanceDouglass C. North · Cambridge University Press eBooks · 1990 · 34,377 citations
- The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection.John E. Ware, Cathy Donald Sherbourne · PubMed · 1992 · 33,943 citations
- Some Tests of Specification for Panel Data: Monte Carlo Evidence and an Application to Employment EquationsManuel Arellano, Stephen R. Bond · The Review of Economic Studies · 1991 · 33,778 citations
- Co-Integration and Error Correction: Representation, Estimation, and TestingRobert F. Engle, C.W.J. Granger · Econometrica · 1987 · 32,847 citations
Questions about this paper
How do I cite this paper in APA style?
Devji, T., Carrasco‐Labra, A., & Guyatt, G. H. (2020). Mind the methods of determining minimal important differences: three critical issues to consider. Evidence-Based Mental Health, 24(2), 77–81. https://doi.org/10.1136/ebmental-2020-300164
How many times has this paper been cited?
82 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at Evidence-Based Mental Health: sign in and open the PDF from this page.
Who wrote this paper?
Tahira Devji, Alonso Carrasco‐Labra, Gordon Henry Guyatt.
What is the DOI of this paper?
10.1136/ebmental-2020-300164, permanently at https://doi.org/10.1136/ebmental-2020-300164. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.