Review article · 2020 · Open access
Implementation outcome instruments for use in physical healthcare settings: a systematic review
Implementation Science, 15(1), 66 · Published 18 August 2020 · DOI 10.1186/s13012-020-01027-6
In brief
“Implementation outcome instruments for use in physical healthcare settings: a systematic review” is a 2020 review article by Zarnie Khadjesari and 8 co-authors, published in Implementation Science. OpenAlex counts 102 citations as of 15 November 2026. It is open access under a CC BY licence: the full text is free to read at Implementation Science.
- Citations
- 102
- Most cited in
- 2023 (25)
- Field-weighted impact
- 1.99
- References
- 104
- Authors
- 9
Abstract
BACKGROUND: Implementation research aims to facilitate the timely and routine implementation and sustainment of evidence-based interventions and services. A glaring gap in this endeavour is the capability of researchers, healthcare practitioners and managers to quantitatively evaluate implementation efforts using psychometrically sound instruments. To encourage and support the use of precise and accurate implementation outcome measures, this systematic review aimed to identify and appraise studies that assess the measurement properties of quantitative implementation outcome instruments used in physical healthcare settings. METHOD: The following data sources were searched from inception to March 2019, with no language restrictions: MEDLINE, EMBASE, PsycINFO, HMIC, CINAHL and the Cochrane library. Studies that evaluated the measurement properties of implementation outcome instruments in physical healthcare settings were eligible for inclusion. Proctor et al.'s taxonomy of implementation outcomes was used to guide the inclusion of implementation outcomes: acceptability, appropriateness, feasibility, adoption, penetration, implementation cost and sustainability. Methodological quality of the included studies was assessed using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Psychometric quality of the included instruments was assessed using the Contemporary Psychometrics checklist (ConPsy). Usability was determined by number of items per instrument. RESULTS: Fifty-eight publications reporting on the measurement properties of 55 implementation outcome instruments (65 scales) were identified. The majority of instruments assessed acceptability (n = 33), followed by appropriateness (n = 7), adoption (n = 4), feasibility (n = 4), penetration (n = 4) and sustainability (n = 3) of evidence-based practice. The methodological quality of individual scales was low, with few studies rated as 'excellent' for reliability (6/62) and validity (7/63), and both studies that assessed responsiveness rated as 'poor' (2/2). The psychometric quality of the scales was also low, with 12/65 scales scoring 7 or more out of 22, indicating greater psychometric strength. Six scales (6/65) rated as 'excellent' for usability. CONCLUSION: Investigators assessing implementation outcomes quantitatively should select instruments based on their methodological and psychometric quality to promote consistent and comparable implementation evaluations. Rather than developing ad hoc instruments, we encourage further psychometric testing of instruments with promising methodological and psychometric evidence. SYSTEMATIC REVIEW REGISTRATION: PROSPERO 2017 CRD42017065348.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Khadjesari, Z., Boufkhed, S., Vitoratou, S., Schatte, L., Ziemann, A., Daskalopoulou, C., Uglik‐Marucha, N., Sevdalis, N., & Hull, L. (2020). Implementation outcome instruments for use in physical healthcare settings: a systematic review. Implementation Science, 15(1), 66. https://doi.org/10.1186/s13012-020-01027-6
MLA 9
Khadjesari, Zarnie, et al. “Implementation outcome instruments for use in physical healthcare settings: a systematic review.” Implementation Science, vol. 15, no. 1, 2020, p. 66. https://doi.org/10.1186/s13012-020-01027-6.
Chicago
Khadjesari, Zarnie, Sabah Boufkhed, Silia Vitoratou, Laura Schatte, Alexandra Ziemann, Christina Daskalopoulou, Nora Uglik‐Marucha, Nick Sevdalis, and Louise Hull. 2020. “Implementation outcome instruments for use in physical healthcare settings: a systematic review.” Implementation Science 15 (1): 66. https://doi.org/10.1186/s13012-020-01027-6.
Harvard
Khadjesari, Z. et al. (2020) ‘Implementation outcome instruments for use in physical healthcare settings: a systematic review’, Implementation Science, 15(1), p. 66. doi:10.1186/s13012-020-01027-6.
IEEE
Z. Khadjesari et al., “Implementation outcome instruments for use in physical healthcare settings: a systematic review,” Implementation Science, vol. 15, no. 1, p. 66, 2020, doi: 10.1186/s13012-020-01027-6.
BibTeX
@article{khadjesari2020implementation,
title = {{Implementation outcome instruments for use in physical healthcare settings: a systematic review}},
author = {Khadjesari, Zarnie and Boufkhed, Sabah and Vitoratou, Silia and Schatte, Laura and Ziemann, Alexandra and Daskalopoulou, Christina and Uglik‐Marucha, Nora and Sevdalis, Nick and Hull, Louise},
journal = {Implementation Science},
year = {2020},
volume = {15},
number = {1},
pages = {66},
doi = {10.1186/s13012-020-01027-6},
url = {https://doi.org/10.1186/s13012-020-01027-6}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2020 | 1 | |
| 2021 | 9 | |
| 2022 | 20 | |
| 2023 | 25 | |
| 2024 | 16 | |
| 2025 | 22 | |
| 2026 | 9 |
Its field-weighted citation impact is 1.99: it has been cited 1.99 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- measurement properties
- psychometric properties
- acceptability
- appropriateness
- feasibility
- adoption
- penetration
- implementation costs
Work with this paper
Most-cited papers in Health Professions
- DETERMINATION OF SERUM PROTEINS BY MEANS OF THE BIURET REACTIONAllan Godfrey Gornall, Charles J. Bardawill, Maxima M. David · Journal of Biological Chemistry · 1949 · 16,172 citations
- Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation scienceLaura J. Damschroder, David Clark Aron, Rosalind E. Keith and 3 more · Implementation Science · 2009 · 15,527 citations
- FUNCTIONAL EVALUATION: THE BARTHEL INDEX.FLORENCE I. MAHONEY, DOROTHEA W. BARTHEL · PubMed · 1965 · 15,488 citations
- The Timed “Up & Go”: A Test of Basic Functional Mobility for Frail Elderly PersonsDiane Podsiadlo, Sandra Richardson · Journal of the American Geriatrics Society · 1991 · 15,001 citations
- National Committee for Clinical Laboratory StandardsErika Bruck · PEDIATRICS · 1980 · 14,735 citations
Questions about this paper
How do I cite this paper in APA style?
Khadjesari, Z., Boufkhed, S., Vitoratou, S., Schatte, L., Ziemann, A., Daskalopoulou, C., Uglik‐Marucha, N., Sevdalis, N., & Hull, L. (2020). Implementation outcome instruments for use in physical healthcare settings: a systematic review. Implementation Science, 15(1), 66. https://doi.org/10.1186/s13012-020-01027-6
How many times has this paper been cited?
102 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text at Implementation Science.
Who wrote this paper?
Zarnie Khadjesari, Sabah Boufkhed, Silia Vitoratou, Laura Schatte, Alexandra Ziemann, Christina Daskalopoulou, Nora Uglik‐Marucha, Nick Sevdalis, Louise Hull.
What is the DOI of this paper?
10.1186/s13012-020-01027-6. The permanent link is https://doi.org/10.1186/s13012-020-01027-6.
Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.