Review article · 2020 · Open access

Mind the methods of determining minimal important differences: three critical issues to consider

Tahira Devji, Alonso Carrasco‐Labra, Gordon Henry Guyatt

Evidence-Based Mental Health, 24(2), 77–81 · Published 24 August 2020 · DOI 10.1136/ebmental-2020-300164

Open PDFView at the publisherCite this paper

In brief

“Mind the methods of determining minimal important differences: three critical issues to consider” is a 2020 review article by Tahira Devji and 2 co-authors, published in Evidence-Based Mental Health. OpenAlex counts 82 citations as of 22 November 2026, which puts it in the top 3% of works published in 2020 by citations. It is open access: the full text is free to read at Evidence-Based Mental Health.

Citations
82
Most cited in
2024 (30)
Field-weighted impact
0.86
References
33
Authors
3

Abstract

OBJECTIVE: Clinical trialists, meta-analysts and clinical guideline developers are increasingly using minimal important differences (MIDs) to enhance the interpretability of patient-reported outcome measures (PROMs). Here, we elucidate three critical issues of which MID users should be aware. Improved understanding of MID concepts and awareness of common pitfalls in methodology and reporting will better inform the application of MIDs in clinical research and decision-making. METHODS: We conducted a systematic review to inform the development of an inventory of anchor-based MID estimates for PROMs. We searched four electronic databases to identify primary studies empirically calculating an anchor-based MID estimate for any PROM in adolescent or adult populations across all clinical areas. Our findings are based on information from 338 studies reporting 3389 MIDs for 358 PROMs published between 1989 and 2015. RESULTS: We identified three key issues in the MID literature that demand attention. (1) The profusion of terms representing the MID concept adds unnecessary complexity to users' task in identifying relevant MIDs, requiring meticulous inspection of methodology to ensure estimates offered truly reflect the MID. (2) A multitude of diverse methods for MID estimation that will yield different estimates exist, and whether there are superior options remains unresolved. (3) There are serious issues of incomplete presentation and reporting of key aspects of the design, methodology and results of studies providing anchor-based MIDs, which threatens the optimal use of these estimates for interpretation of intervention effects on PROMs. CONCLUSIONS: Although the MID represents a powerful tool for enhancing the interpretability of PROMs, realising its full value will require improved understanding and reporting of its measurement fundamentals.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Devji, T., Carrasco‐Labra, A., & Guyatt, G. H. (2020). Mind the methods of determining minimal important differences: three critical issues to consider. Evidence-Based Mental Health, 24(2), 77–81. https://doi.org/10.1136/ebmental-2020-300164

MLA 9

Devji, Tahira, et al. “Mind the methods of determining minimal important differences: three critical issues to consider.” Evidence-Based Mental Health, vol. 24, no. 2, 2020, pp. 77–81. https://doi.org/10.1136/ebmental-2020-300164.

Chicago

Devji, Tahira, Alonso Carrasco‐Labra, and Gordon Henry Guyatt. 2020. “Mind the methods of determining minimal important differences: three critical issues to consider.” Evidence-Based Mental Health 24 (2): 77–81. https://doi.org/10.1136/ebmental-2020-300164.

Harvard

Devji, T., Carrasco‐Labra, A. and Guyatt, G. H. (2020) ‘Mind the methods of determining minimal important differences: three critical issues to consider’, Evidence-Based Mental Health, 24(2), pp. 77–81. doi:10.1136/ebmental-2020-300164.

IEEE

T. Devji, A. Carrasco‐Labra, and G. H. Guyatt, “Mind the methods of determining minimal important differences: three critical issues to consider,” Evidence-Based Mental Health, vol. 24, no. 2, pp. 77–81, 2020, doi: 10.1136/ebmental-2020-300164.

BibTeX

@article{devji2020mind,
  title     = {{Mind the methods of determining minimal important differences: three critical issues to consider}},
  author    = {Devji, Tahira and Carrasco‐Labra, Alonso and Guyatt, Gordon Henry},
  journal   = {Evidence-Based Mental Health},
  year      = {2020},
  volume    = {24},
  number    = {2},
  pages     = {77--81},
  doi       = {10.1136/ebmental-2020-300164},
  url       = {https://doi.org/10.1136/ebmental-2020-300164}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202155
20221313
20231010
20243030
202599
20261515

Its field-weighted citation impact is 0.86: it has been cited 0.86 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life

  • minimal important difference
  • patient-reported outcome measures
  • clinical trial interpretation

Work with this paper

Most-cited papers in Economics, Econometrics and Finance

All highly cited Economics, Econometrics and Finance papers

Questions about this paper

How do I cite this paper in APA style?

Devji, T., Carrasco‐Labra, A., & Guyatt, G. H. (2020). Mind the methods of determining minimal important differences: three critical issues to consider. Evidence-Based Mental Health, 24(2), 77–81. https://doi.org/10.1136/ebmental-2020-300164

How many times has this paper been cited?

82 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at Evidence-Based Mental Health: sign in and open the PDF from this page.

Who wrote this paper?

Tahira Devji, Alonso Carrasco‐Labra, Gordon Henry Guyatt.

What is the DOI of this paper?

10.1136/ebmental-2020-300164, permanently at https://doi.org/10.1136/ebmental-2020-300164. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.