Review article · 2025 · Open access

Do process evaluations open up the ‘black box’ of implementation interventions in health care? A scoping review

Ella L. Bracci, Sarah Collyer, Candice Oster, Elizabeth Lynch, Temitope Olasunkanmi‐Alimi, Lemma N Bulto, Gill Harvey

Implementation Science, 20(1), 55 · Published 24 December 2025 · DOI 10.1186/s13012-025-01468-x

Free PDFView at the publisherCite this paper

In brief

“Do process evaluations open up the ‘black box’ of implementation interventions in health care? A scoping review” is a 2025 review article by Ella L. Bracci and 6 co-authors, published in Implementation Science. OpenAlex counts 7 citations as of 16 November 2026, which puts it in the top 2% of works published in 2025 by citations. It is open access under a CC BY-NC-ND licence: the full text is free to read at Implementation Science.

Citations
7
Most cited in
2026 (7)
Field-weighted impact
0.88
References
121
Authors
7

Abstract

BACKGROUND: Process evaluations are considered an essential component in conducting and reporting complex interventions, such as those studied in randomised controlled trials (RCTs) of implementation interventions, to explain the effect of implementation interventions. Given the growth of RCTs of implementation interventions with embedded process evaluations, it is timely to review the explanatory learnings to date. This scoping review explores process evaluations of RCTs of implementation interventions to examine how studies are conducted and what insights can be offered about how and why implementation interventions achieve (or not) their intended impacts. METHODS: The scoping review was conducted in accordance with the JBI methodology. MEDLINE, CINAHL, Scopus, Web of Science and PsycINFO were searched. Articles were screened and data were extracted by two independent reviewers. RESULTS: Of the 5857 studies screened, 81 process evaluations were included. Two process evaluations reported on the same trial, resulting in a final number of n = 80 independent studies. Half of studies (48%) reported on implementation trials with no demonstrated effect on the primary outcome (null), while n = 32 (40%) reported on trials where the intervention group demonstrated positive changes in the primary outcome (positive). Seven studies (9%) had mixed findings and n = 3 (4%) studies had no reported trial outcomes. When comparing process evaluation findings from positive and null trials, few discernible patterns that clearly explained the difference in outcomes were identified. Education and training was the most common strategy used in implementation interventions, yet one of the most common implementation barriers reported related to knowledge and self-efficacy, which could indicate a misalignment. Availability of resources was the most prominent barrier for both positive and null trials and there was little evidence that implementation interventions were tailored to context despite prominent barriers and enablers at the inner and outer setting level. CONCLUSIONS: Process evaluation studies embedded in RCTs of implementation interventions are recommended as an important method to explain whether and how interventions produce their intended effect. This review suggests a need to further optimise the design and evaluation of implementation interventions, including the conduct and reporting of process evaluations, to continue advancing the science and practice of implementation. TRIAL REGISTRATION: Protocol published in Open Science Framework, May 10 2022 (Collyer et al., Process evaluations in randomised trials of implementation interventions in health care: a scoping review protocol. In Open science framework, 2022).

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Bracci, E. L., Collyer, S., Oster, C., Lynch, E., Olasunkanmi‐Alimi, T., Bulto, L. N., & Harvey, G. (2025). Do process evaluations open up the ‘black box’ of implementation interventions in health care? A scoping review. Implementation Science, 20(1), 55. https://doi.org/10.1186/s13012-025-01468-x

MLA 9

Bracci, Ella L., et al. “Do process evaluations open up the ‘black box’ of implementation interventions in health care? A scoping review.” Implementation Science, vol. 20, no. 1, 2025, p. 55. https://doi.org/10.1186/s13012-025-01468-x.

Chicago

Bracci, Ella L., Sarah Collyer, Candice Oster, Elizabeth Lynch, Temitope Olasunkanmi‐Alimi, Lemma N Bulto, and Gill Harvey. 2025. “Do process evaluations open up the ‘black box’ of implementation interventions in health care? A scoping review.” Implementation Science 20 (1): 55. https://doi.org/10.1186/s13012-025-01468-x.

Harvard

Bracci, E. L. et al. (2025) ‘Do process evaluations open up the ‘black box’ of implementation interventions in health care? A scoping review’, Implementation Science, 20(1), p. 55. doi:10.1186/s13012-025-01468-x.

IEEE

E. L. Bracci et al., “Do process evaluations open up the ‘black box’ of implementation interventions in health care? A scoping review,” Implementation Science, vol. 20, no. 1, p. 55, 2025, doi: 10.1186/s13012-025-01468-x.

BibTeX

@article{bracci2025process,
  title     = {{Do process evaluations open up the ‘black box’ of implementation interventions in health care? A scoping review}},
  author    = {Bracci, Ella L. and Collyer, Sarah and Oster, Candice and Lynch, Elizabeth and Olasunkanmi‐Alimi, Temitope and Bulto, Lemma N and Harvey, Gill},
  journal   = {Implementation Science},
  year      = {2025},
  volume    = {20},
  number    = {1},
  pages     = {55},
  doi       = {10.1186/s13012-025-01468-x},
  url       = {https://doi.org/10.1186/s13012-025-01468-x}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science

  • process evaluation
  • implementation strategies
  • complex interventions
  • randomized controlled trials
  • health care
  • implementation barriers
  • implementation facilitators
  • education and training

Work with this paper

Most-cited papers in Health Professions

All highly cited Health Professions papers

Questions about this paper

How do I cite this paper in APA style?

Bracci, E. L., Collyer, S., Oster, C., Lynch, E., Olasunkanmi‐Alimi, T., Bulto, L. N., & Harvey, G. (2025). Do process evaluations open up the ‘black box’ of implementation interventions in health care? A scoping review. Implementation Science, 20(1), 55. https://doi.org/10.1186/s13012-025-01468-x

How many times has this paper been cited?

7 times, according to OpenAlex on 16 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at Implementation Science.

Who wrote this paper?

Ella L. Bracci, Sarah Collyer, Candice Oster, Elizabeth Lynch, Temitope Olasunkanmi‐Alimi, Lemma N Bulto, Gill Harvey.

What is the DOI of this paper?

10.1186/s13012-025-01468-x. The permanent link is https://doi.org/10.1186/s13012-025-01468-x.

Bibliographic data from OpenAlex (CC0), last checked 16 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.