Review article · 2020 · Open access

Implementation outcome instruments for use in physical healthcare settings: a systematic review

Zarnie Khadjesari, Sabah Boufkhed, Silia Vitoratou, Laura Schatte, Alexandra Ziemann, Christina Daskalopoulou, Nora Uglik‐Marucha, Nick Sevdalis, Louise Hull

Implementation Science, 15(1), 66 · Published 18 August 2020 · DOI 10.1186/s13012-020-01027-6

Free PDFView at the publisherCite this paper

In brief

“Implementation outcome instruments for use in physical healthcare settings: a systematic review” is a 2020 review article by Zarnie Khadjesari and 8 co-authors, published in Implementation Science. OpenAlex counts 102 citations as of 15 November 2026. It is open access under a CC BY licence: the full text is free to read at Implementation Science.

Citations
102
Most cited in
2023 (25)
Field-weighted impact
1.99
References
104
Authors
9

Abstract

BACKGROUND: Implementation research aims to facilitate the timely and routine implementation and sustainment of evidence-based interventions and services. A glaring gap in this endeavour is the capability of researchers, healthcare practitioners and managers to quantitatively evaluate implementation efforts using psychometrically sound instruments. To encourage and support the use of precise and accurate implementation outcome measures, this systematic review aimed to identify and appraise studies that assess the measurement properties of quantitative implementation outcome instruments used in physical healthcare settings. METHOD: The following data sources were searched from inception to March 2019, with no language restrictions: MEDLINE, EMBASE, PsycINFO, HMIC, CINAHL and the Cochrane library. Studies that evaluated the measurement properties of implementation outcome instruments in physical healthcare settings were eligible for inclusion. Proctor et al.'s taxonomy of implementation outcomes was used to guide the inclusion of implementation outcomes: acceptability, appropriateness, feasibility, adoption, penetration, implementation cost and sustainability. Methodological quality of the included studies was assessed using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Psychometric quality of the included instruments was assessed using the Contemporary Psychometrics checklist (ConPsy). Usability was determined by number of items per instrument. RESULTS: Fifty-eight publications reporting on the measurement properties of 55 implementation outcome instruments (65 scales) were identified. The majority of instruments assessed acceptability (n = 33), followed by appropriateness (n = 7), adoption (n = 4), feasibility (n = 4), penetration (n = 4) and sustainability (n = 3) of evidence-based practice. The methodological quality of individual scales was low, with few studies rated as 'excellent' for reliability (6/62) and validity (7/63), and both studies that assessed responsiveness rated as 'poor' (2/2). The psychometric quality of the scales was also low, with 12/65 scales scoring 7 or more out of 22, indicating greater psychometric strength. Six scales (6/65) rated as 'excellent' for usability. CONCLUSION: Investigators assessing implementation outcomes quantitatively should select instruments based on their methodological and psychometric quality to promote consistent and comparable implementation evaluations. Rather than developing ad hoc instruments, we encourage further psychometric testing of instruments with promising methodological and psychometric evidence. SYSTEMATIC REVIEW REGISTRATION: PROSPERO 2017 CRD42017065348.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Khadjesari, Z., Boufkhed, S., Vitoratou, S., Schatte, L., Ziemann, A., Daskalopoulou, C., Uglik‐Marucha, N., Sevdalis, N., & Hull, L. (2020). Implementation outcome instruments for use in physical healthcare settings: a systematic review. Implementation Science, 15(1), 66. https://doi.org/10.1186/s13012-020-01027-6

MLA 9

Khadjesari, Zarnie, et al. “Implementation outcome instruments for use in physical healthcare settings: a systematic review.” Implementation Science, vol. 15, no. 1, 2020, p. 66. https://doi.org/10.1186/s13012-020-01027-6.

Chicago

Khadjesari, Zarnie, Sabah Boufkhed, Silia Vitoratou, Laura Schatte, Alexandra Ziemann, Christina Daskalopoulou, Nora Uglik‐Marucha, Nick Sevdalis, and Louise Hull. 2020. “Implementation outcome instruments for use in physical healthcare settings: a systematic review.” Implementation Science 15 (1): 66. https://doi.org/10.1186/s13012-020-01027-6.

Harvard

Khadjesari, Z. et al. (2020) ‘Implementation outcome instruments for use in physical healthcare settings: a systematic review’, Implementation Science, 15(1), p. 66. doi:10.1186/s13012-020-01027-6.

IEEE

Z. Khadjesari et al., “Implementation outcome instruments for use in physical healthcare settings: a systematic review,” Implementation Science, vol. 15, no. 1, p. 66, 2020, doi: 10.1186/s13012-020-01027-6.

BibTeX

@article{khadjesari2020implementation,
  title     = {{Implementation outcome instruments for use in physical healthcare settings: a systematic review}},
  author    = {Khadjesari, Zarnie and Boufkhed, Sabah and Vitoratou, Silia and Schatte, Laura and Ziemann, Alexandra and Daskalopoulou, Christina and Uglik‐Marucha, Nora and Sevdalis, Nick and Hull, Louise},
  journal   = {Implementation Science},
  year      = {2020},
  volume    = {15},
  number    = {1},
  pages     = {66},
  doi       = {10.1186/s13012-020-01027-6},
  url       = {https://doi.org/10.1186/s13012-020-01027-6}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202011
202199
20222020
20232525
20241616
20252222
202699

Its field-weighted citation impact is 1.99: it has been cited 1.99 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science

  • measurement properties
  • psychometric properties
  • acceptability
  • appropriateness
  • feasibility
  • adoption
  • penetration
  • implementation costs

Work with this paper

Most-cited papers in Health Professions

All highly cited Health Professions papers

Questions about this paper

How do I cite this paper in APA style?

Khadjesari, Z., Boufkhed, S., Vitoratou, S., Schatte, L., Ziemann, A., Daskalopoulou, C., Uglik‐Marucha, N., Sevdalis, N., & Hull, L. (2020). Implementation outcome instruments for use in physical healthcare settings: a systematic review. Implementation Science, 15(1), 66. https://doi.org/10.1186/s13012-020-01027-6

How many times has this paper been cited?

102 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at Implementation Science.

Who wrote this paper?

Zarnie Khadjesari, Sabah Boufkhed, Silia Vitoratou, Laura Schatte, Alexandra Ziemann, Christina Daskalopoulou, Nora Uglik‐Marucha, Nick Sevdalis, Louise Hull.

What is the DOI of this paper?

10.1186/s13012-020-01027-6. The permanent link is https://doi.org/10.1186/s13012-020-01027-6.

Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.