Journal article · 2020 · Open access

Evaluating the credibility of anchor based estimates of minimal important differences for patient reported outcomes: instrument development and reliability study

Tahira Devji, Alonso Carrasco‐Labra, Anila Qasim, Mark Phillips, Bradley C. Johnston, Niveditha Devasenapathy, Dena Zeraatkar, Meha Bhatt, Xuejing Jin, Romina Brignardello‐Petersen, Olivia Urquhart, Farid Foroutan and 15 more

BMJ, 369, m1714 · Published 4 June 2020 · DOI 10.1136/bmj.m1714

Open PDFView at the publisherCite this paper

In brief

“Evaluating the credibility of anchor based estimates of minimal important differences for patient reported outcomes: instrument development and reliability study” is a 2020 journal article by Tahira Devji and 26 co-authors, published in BMJ. OpenAlex counts 301 citations as of 22 November 2026, which puts it in the top 3% of works published in 2020 by citations. It is open access under a CC BY-NC licence: the full text is free to read at BMJ.

Citations
301
Most cited in
2024 (65)
Field-weighted impact
22.99
References
97
Authors
27

Abstract

OBJECTIVE: To develop an instrument to evaluate the credibility of anchor based minimal important differences (MIDs) for outcome measures reported by patients, and to assess the reliability of the instrument. DESIGN: Instrument development and reliability study. DATA SOURCES: Initial criteria were developed for evaluating the credibility of anchor based MIDs based on a literature review (Medline, Embase, CINAHL, and PsycInfo databases) and the experience of the authors in the methodology for estimation of MIDs. Iterative discussions by the team and pilot testing with experts and potential users facilitated the development of the final instrument. PARTICIPANTS: With the newly developed instrument, pairs of masters, doctoral, or postdoctoral students with a background in health research methodology independently evaluated the credibility of a sample of MID estimates. MAIN OUTCOME MEASURES: Core credibility criteria applicable to all anchor types, additional criteria for transition rating anchors, and inter-rater reliability coefficients were determined. RESULTS: The credibility instrument has five core criteria: the anchor is rated by the patient; the anchor is interpretable and relevant to the patient; the MID estimate is precise; the correlation between the anchor and the outcome measure reported by the patient is satisfactory; and the authors select a threshold on the anchor that reflects a small but important difference. The additional criteria for transition rating anchors are: the time elapsed between baseline and follow-up measurement for estimation of the MID is optimal; and the correlations of the transition rating with the baseline, follow-up, and change score in the patient reported outcome measures are satisfactory. Inter-rater reliability coefficients (ĸ) for the core criteria and for one item from the additional criteria ranged from 0.70 to 0.94. Reporting issues prevented the evaluation of the reliability of the three other additional criteria for the transition rating anchors. CONCLUSIONS: Researchers, clinicians, and healthcare policy decision makers can consider using this instrument to evaluate the design, conduct, and analysis of studies estimating anchor based minimal important differences.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Devji, T., Carrasco‐Labra, A., Qasim, A., Phillips, M., Johnston, B. C., Devasenapathy, N., Zeraatkar, D., Bhatt, M., Jin, X., Brignardello‐Petersen, R., Urquhart, O., Foroutan, F., Schandelmaier, S., Hernandez, H. P., Vernooij, R. W., Huang, H., Rizwan, Y., Siemieniuk, R. A. C., Lytvyn, L., . . . Guyatt, G. H. (2020). Evaluating the credibility of anchor based estimates of minimal important differences for patient reported outcomes: instrument development and reliability study. BMJ, 369, m1714. https://doi.org/10.1136/bmj.m1714

MLA 9

Devji, Tahira, et al. “Evaluating the credibility of anchor based estimates of minimal important differences for patient reported outcomes: instrument development and reliability study.” BMJ, vol. 369, 2020, p. m1714. https://doi.org/10.1136/bmj.m1714.

Chicago

Devji, Tahira, Alonso Carrasco‐Labra, Anila Qasim, Mark Phillips, Bradley C. Johnston, Niveditha Devasenapathy, Dena Zeraatkar, et al. 2020. “Evaluating the credibility of anchor based estimates of minimal important differences for patient reported outcomes: instrument development and reliability study.” BMJ 369: m1714. https://doi.org/10.1136/bmj.m1714.

Harvard

Devji, T. et al. (2020) ‘Evaluating the credibility of anchor based estimates of minimal important differences for patient reported outcomes: instrument development and reliability study’, BMJ, 369, p. m1714. doi:10.1136/bmj.m1714.

IEEE

T. Devji et al., “Evaluating the credibility of anchor based estimates of minimal important differences for patient reported outcomes: instrument development and reliability study,” BMJ, vol. 369, p. m1714, 2020, doi: 10.1136/bmj.m1714.

BibTeX

@article{devji2020evaluating,
  title     = {{Evaluating the credibility of anchor based estimates of minimal important differences for patient reported outcomes: instrument development and reliability study}},
  author    = {Devji, Tahira and Carrasco‐Labra, Alonso and Qasim, Anila and Phillips, Mark and Johnston, Bradley C. and Devasenapathy, Niveditha and Zeraatkar, Dena and Bhatt, Meha and Jin, Xuejing and Brignardello‐Petersen, Romina and Urquhart, Olivia and Foroutan, Farid and Schandelmaier, Stefan and Hernandez, Hector Pardo and Vernooij, Robin W.M. and Huang, Hsiaomin and Rizwan, Yamna and Siemieniuk, Reed Alexander Cunningham and Lytvyn, Lyubov and Patrick, Donald L. and Ebrahim, Shanil and Furukawa, Toshi A. and NESRALLAH, Gihad E. and Schünemann, Holger Jens and Bhandari, Mohit and Thabane, Lehana and Guyatt, Gordon Henry},
  journal   = {BMJ},
  year      = {2020},
  volume    = {369},
  pages     = {m1714},
  doi       = {10.1136/bmj.m1714},
  url       = {https://doi.org/10.1136/bmj.m1714}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202055
20213535
20224040
20235353
20246565
20254747
20265656

Its field-weighted citation impact is 22.99: it has been cited 22.99 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life

  • minimal important difference
  • anchor-based estimation
  • patient-reported outcomes
  • credibility criteria
  • instrument development
  • inter-rater reliability
  • study design critique

Work with this paper

Most-cited papers in Economics, Econometrics and Finance

All highly cited Economics, Econometrics and Finance papers

Questions about this paper

How do I cite this paper in APA style?

Devji, T., Carrasco‐Labra, A., Qasim, A., Phillips, M., Johnston, B. C., Devasenapathy, N., Zeraatkar, D., Bhatt, M., Jin, X., Brignardello‐Petersen, R., Urquhart, O., Foroutan, F., Schandelmaier, S., Hernandez, H. P., Vernooij, R. W., Huang, H., Rizwan, Y., Siemieniuk, R. A. C., Lytvyn, L., . . . Guyatt, G. H. (2020). Evaluating the credibility of anchor based estimates of minimal important differences for patient reported outcomes: instrument development and reliability study. BMJ, 369, m1714. https://doi.org/10.1136/bmj.m1714

How many times has this paper been cited?

301 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at BMJ: sign in and open the PDF from this page.

Who wrote this paper?

Tahira Devji, Alonso Carrasco‐Labra, Anila Qasim, Mark Phillips, Bradley C. Johnston, Niveditha Devasenapathy, Dena Zeraatkar, Meha Bhatt, Xuejing Jin, Romina Brignardello‐Petersen, Olivia Urquhart, Farid Foroutan and 15 more.

What is the DOI of this paper?

10.1136/bmj.m1714, permanently at https://doi.org/10.1136/bmj.m1714. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.