Review article · 2023 · Open access

Ten years of implementation outcomes research: a scoping review

Enola K. Proctor, Alicia C. Bunger, Rebecca Lengnick‐Hall, Donald R. Gerke, Jared K. Martin, Rebecca J. Phillips, Julia C. Swanson

Implementation Science, 18(1), 31 · Published 25 July 2023 · DOI 10.1186/s13012-023-01286-z

Free PDFView at the publisherCite this paper

In brief

“Ten years of implementation outcomes research: a scoping review” is a 2023 review article by Enola K. Proctor and 6 co-authors, published in Implementation Science. OpenAlex counts 516 citations as of 15 November 2026, which puts it in the top 1% of works published in 2023 by citations. It is open access under a CC BY licence: the full text is free to read at Implementation Science.

Citations
516
Most cited in
2026 (215)
Field-weighted impact
19.23
References
69
Authors
7

Abstract

BACKGROUND: Proctor and colleagues' 2011 paper proposed a taxonomy of eight implementation outcomes and challenged the field to address a research agenda focused on conceptualization, measurement, and theory building. Ten years later, this paper maps the field's progress in implementation outcomes research. This scoping review describes how each implementation outcome has been studied, research designs and methods used, and the contexts and settings represented in the current literature. We also describe the role of implementation outcomes in relation to implementation strategies and other outcomes. METHODS: Arksey and O'Malley's framework for conducting scoping reviews guided our methods. Using forward citation tracing, we identified all literature citing the 2011 paper. We conducted our search in the Web of Science (WOS) database and added citation alerts sent to the first author from the publisher for a 6-month period coinciding with the WOS citation search. This produced 1346 titles and abstracts. Initial abstract screening yielded 480 manuscripts, and full-text review yielded 400 manuscripts that met inclusion criteria (empirical assessment of at least one implementation outcome). RESULTS: Slightly more than half (52.1%) of included manuscripts examined acceptability. Fidelity (39.3%), feasibility (38.6%), adoption (26.5%), and appropriateness (21.8%) were also commonly examined. Penetration (16.0%), sustainability (15.8%), and cost (7.8%) were less frequently examined. Thirty-two manuscripts examined implementation outcomes not included in the original taxonomy. Most studies took place in healthcare (45.8%) or behavioral health (22.5%) organizations. Two-thirds used observational designs. We found little evidence of progress in testing the relationships between implementation strategies and implementation outcomes, leaving us ill-prepared to know how to achieve implementation success. Moreover, few studies tested the impact of implementation outcomes on other important outcome types, such as service systems and improved individual or population health. CONCLUSIONS: Our review presents a comprehensive snapshot of the research questions being addressed by existing implementation outcomes literature and reveals the need for rigorous, analytic research and tests of strategies for attaining implementation outcomes in the next 10 years of outcomes research.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Proctor, E. K., Bunger, A. C., Lengnick‐Hall, R., Gerke, D. R., Martin, J. K., Phillips, R. J., & Swanson, J. C. (2023). Ten years of implementation outcomes research: a scoping review. Implementation Science, 18(1), 31. https://doi.org/10.1186/s13012-023-01286-z

MLA 9

Proctor, Enola K., et al. “Ten years of implementation outcomes research: a scoping review.” Implementation Science, vol. 18, no. 1, 2023, p. 31. https://doi.org/10.1186/s13012-023-01286-z.

Chicago

Proctor, Enola K., Alicia C. Bunger, Rebecca Lengnick‐Hall, Donald R. Gerke, Jared K. Martin, Rebecca J. Phillips, and Julia C. Swanson. 2023. “Ten years of implementation outcomes research: a scoping review.” Implementation Science 18 (1): 31. https://doi.org/10.1186/s13012-023-01286-z.

Harvard

Proctor, E. K. et al. (2023) ‘Ten years of implementation outcomes research: a scoping review’, Implementation Science, 18(1), p. 31. doi:10.1186/s13012-023-01286-z.

IEEE

E. K. Proctor et al., “Ten years of implementation outcomes research: a scoping review,” Implementation Science, vol. 18, no. 1, p. 31, 2023, doi: 10.1186/s13012-023-01286-z.

BibTeX

@article{proctor2023years,
  title     = {{Ten years of implementation outcomes research: a scoping review}},
  author    = {Proctor, Enola K. and Bunger, Alicia C. and Lengnick‐Hall, Rebecca and Gerke, Donald R. and Martin, Jared K. and Phillips, Rebecca J. and Swanson, Julia C.},
  journal   = {Implementation Science},
  year      = {2023},
  volume    = {18},
  number    = {1},
  pages     = {31},
  doi       = {10.1186/s13012-023-01286-z},
  url       = {https://doi.org/10.1186/s13012-023-01286-z}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
20231313
2024101101
2025187187
2026215215

Its field-weighted citation impact is 19.23: it has been cited 19.23 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science

  • implementation outcomes
  • acceptability
  • fidelity
  • feasibility
  • adoption
  • appropriateness
  • penetration
  • sustainability

Work with this paper

Most-cited papers in Health Professions

All highly cited Health Professions papers

Questions about this paper

How do I cite this paper in APA style?

Proctor, E. K., Bunger, A. C., Lengnick‐Hall, R., Gerke, D. R., Martin, J. K., Phillips, R. J., & Swanson, J. C. (2023). Ten years of implementation outcomes research: a scoping review. Implementation Science, 18(1), 31. https://doi.org/10.1186/s13012-023-01286-z

How many times has this paper been cited?

516 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at Implementation Science.

Who wrote this paper?

Enola K. Proctor, Alicia C. Bunger, Rebecca Lengnick‐Hall, Donald R. Gerke, Jared K. Martin, Rebecca J. Phillips, Julia C. Swanson.

What is the DOI of this paper?

10.1186/s13012-023-01286-z. The permanent link is https://doi.org/10.1186/s13012-023-01286-z.

Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.