Review article · 2023 · Open access
Ten years of implementation outcomes research: a scoping review
Implementation Science, 18(1), 31 · Published 25 July 2023 · DOI 10.1186/s13012-023-01286-z
In brief
“Ten years of implementation outcomes research: a scoping review” is a 2023 review article by Enola K. Proctor and 6 co-authors, published in Implementation Science. OpenAlex counts 516 citations as of 15 November 2026, which puts it in the top 1% of works published in 2023 by citations. It is open access under a CC BY licence: the full text is free to read at Implementation Science.
- Citations
- 516
- Most cited in
- 2026 (215)
- Field-weighted impact
- 19.23
- References
- 69
- Authors
- 7
Abstract
BACKGROUND: Proctor and colleagues' 2011 paper proposed a taxonomy of eight implementation outcomes and challenged the field to address a research agenda focused on conceptualization, measurement, and theory building. Ten years later, this paper maps the field's progress in implementation outcomes research. This scoping review describes how each implementation outcome has been studied, research designs and methods used, and the contexts and settings represented in the current literature. We also describe the role of implementation outcomes in relation to implementation strategies and other outcomes. METHODS: Arksey and O'Malley's framework for conducting scoping reviews guided our methods. Using forward citation tracing, we identified all literature citing the 2011 paper. We conducted our search in the Web of Science (WOS) database and added citation alerts sent to the first author from the publisher for a 6-month period coinciding with the WOS citation search. This produced 1346 titles and abstracts. Initial abstract screening yielded 480 manuscripts, and full-text review yielded 400 manuscripts that met inclusion criteria (empirical assessment of at least one implementation outcome). RESULTS: Slightly more than half (52.1%) of included manuscripts examined acceptability. Fidelity (39.3%), feasibility (38.6%), adoption (26.5%), and appropriateness (21.8%) were also commonly examined. Penetration (16.0%), sustainability (15.8%), and cost (7.8%) were less frequently examined. Thirty-two manuscripts examined implementation outcomes not included in the original taxonomy. Most studies took place in healthcare (45.8%) or behavioral health (22.5%) organizations. Two-thirds used observational designs. We found little evidence of progress in testing the relationships between implementation strategies and implementation outcomes, leaving us ill-prepared to know how to achieve implementation success. Moreover, few studies tested the impact of implementation outcomes on other important outcome types, such as service systems and improved individual or population health. CONCLUSIONS: Our review presents a comprehensive snapshot of the research questions being addressed by existing implementation outcomes literature and reveals the need for rigorous, analytic research and tests of strategies for attaining implementation outcomes in the next 10 years of outcomes research.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Proctor, E. K., Bunger, A. C., Lengnick‐Hall, R., Gerke, D. R., Martin, J. K., Phillips, R. J., & Swanson, J. C. (2023). Ten years of implementation outcomes research: a scoping review. Implementation Science, 18(1), 31. https://doi.org/10.1186/s13012-023-01286-z
MLA 9
Proctor, Enola K., et al. “Ten years of implementation outcomes research: a scoping review.” Implementation Science, vol. 18, no. 1, 2023, p. 31. https://doi.org/10.1186/s13012-023-01286-z.
Chicago
Proctor, Enola K., Alicia C. Bunger, Rebecca Lengnick‐Hall, Donald R. Gerke, Jared K. Martin, Rebecca J. Phillips, and Julia C. Swanson. 2023. “Ten years of implementation outcomes research: a scoping review.” Implementation Science 18 (1): 31. https://doi.org/10.1186/s13012-023-01286-z.
Harvard
Proctor, E. K. et al. (2023) ‘Ten years of implementation outcomes research: a scoping review’, Implementation Science, 18(1), p. 31. doi:10.1186/s13012-023-01286-z.
IEEE
E. K. Proctor et al., “Ten years of implementation outcomes research: a scoping review,” Implementation Science, vol. 18, no. 1, p. 31, 2023, doi: 10.1186/s13012-023-01286-z.
BibTeX
@article{proctor2023years,
title = {{Ten years of implementation outcomes research: a scoping review}},
author = {Proctor, Enola K. and Bunger, Alicia C. and Lengnick‐Hall, Rebecca and Gerke, Donald R. and Martin, Jared K. and Phillips, Rebecca J. and Swanson, Julia C.},
journal = {Implementation Science},
year = {2023},
volume = {18},
number = {1},
pages = {31},
doi = {10.1186/s13012-023-01286-z},
url = {https://doi.org/10.1186/s13012-023-01286-z}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2023 | 13 | |
| 2024 | 101 | |
| 2025 | 187 | |
| 2026 | 215 |
Its field-weighted citation impact is 19.23: it has been cited 19.23 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- implementation outcomes
- acceptability
- fidelity
- feasibility
- adoption
- appropriateness
- penetration
- sustainability
Work with this paper
Most-cited papers in Health Professions
- DETERMINATION OF SERUM PROTEINS BY MEANS OF THE BIURET REACTIONAllan Godfrey Gornall, Charles J. Bardawill, Maxima M. David · Journal of Biological Chemistry · 1949 · 16,172 citations
- Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation scienceLaura J. Damschroder, David Clark Aron, Rosalind E. Keith and 3 more · Implementation Science · 2009 · 15,527 citations
- FUNCTIONAL EVALUATION: THE BARTHEL INDEX.FLORENCE I. MAHONEY, DOROTHEA W. BARTHEL · PubMed · 1965 · 15,488 citations
- The Timed “Up & Go”: A Test of Basic Functional Mobility for Frail Elderly PersonsDiane Podsiadlo, Sandra Richardson · Journal of the American Geriatrics Society · 1991 · 15,001 citations
- National Committee for Clinical Laboratory StandardsErika Bruck · PEDIATRICS · 1980 · 14,735 citations
Questions about this paper
How do I cite this paper in APA style?
Proctor, E. K., Bunger, A. C., Lengnick‐Hall, R., Gerke, D. R., Martin, J. K., Phillips, R. J., & Swanson, J. C. (2023). Ten years of implementation outcomes research: a scoping review. Implementation Science, 18(1), 31. https://doi.org/10.1186/s13012-023-01286-z
How many times has this paper been cited?
516 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text at Implementation Science.
Who wrote this paper?
Enola K. Proctor, Alicia C. Bunger, Rebecca Lengnick‐Hall, Donald R. Gerke, Jared K. Martin, Rebecca J. Phillips, Julia C. Swanson.
What is the DOI of this paper?
10.1186/s13012-023-01286-z. The permanent link is https://doi.org/10.1186/s13012-023-01286-z.
Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.