Journal article · 2014 · Open access
Protocol for the process evaluation of a complex intervention designed to increase the use of research in health policy and program organisations (the SPIRIT study)
Implementation Science, 9(1), 113 · Published 26 September 2014 · DOI 10.1186/s13012-014-0113-0
In brief
“Protocol for the process evaluation of a complex intervention designed to increase the use of research in health policy and program organisations (the SPIRIT study)” is a 2014 journal article by the CIPHER team and 7 co-authors, published in Implementation Science. OpenAlex counts 48 citations as of 15 November 2026. It is open access under a CC BY licence: the full text is free to read at Implementation Science.
- Citations
- 48
- Most cited in
- 2021 (9)
- Field-weighted impact
- 3.88
- References
- 60
- Authors
- 8
Abstract
BACKGROUND: Process evaluation is vital for understanding how interventions function in different settings, including if and why they have different effects or do not work at all. This is particularly important in trials of complex interventions in 'real world' organisational settings where causality is difficult to determine. Complexity presents challenges for process evaluation, and process evaluations that tackle complexity are rarely reported. This paper presents the detailed protocol for a process evaluation embedded in a randomised trial of a complex intervention known as SPIRIT (Supporting Policy In health with Research: an Intervention Trial). SPIRIT aims to build capacity for using research in health policy and program agencies. METHODS: We describe the flexible and pragmatic methods used for capturing, managing and analysing data across three domains: (a) the intervention as it was implemented; (b) how people participated in and responded to the intervention; and (c) the contextual characteristics that mediated this relationship and may influence outcomes. Qualitative and quantitative data collection methods include purposively sampled semi-structured interviews at two time points, direct observation and coding of intervention activities, and participant feedback forms. We provide examples of the data collection and data management tools developed. DISCUSSION: This protocol provides a worked example of how to embed process evaluation in the design and evaluation of a complex intervention trial. It tackles complexity in the intervention and its implementation settings. To our knowledge, it is the only detailed example of the methods for a process evaluation of an intervention conducted as part of a randomised trial in policy organisations. We identify strengths and weaknesses, and discuss how the methods are functioning during early implementation. Using 'insider' consultation to develop methods is enabling us to optimise data collection while minimising discomfort and burden for participants. Embedding the process evaluation within the trial design is facilitating access to data, but may impair participants' willingness to talk openly in interviews. While it is challenging to evaluate the process of conducting a randomised trial of a complex intervention, our experience so far suggests that it is feasible and can add considerably to the knowledge generated.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
the CIPHER team, Haynes, A. S., Brennan, S., Carter, S. M., O’Connor, D. A., Schneider, C. H., Turner, T., & Gallego, G. (2014). Protocol for the process evaluation of a complex intervention designed to increase the use of research in health policy and program organisations (the SPIRIT study). Implementation Science, 9(1), 113. https://doi.org/10.1186/s13012-014-0113-0
MLA 9
the CIPHER team, et al. “Protocol for the process evaluation of a complex intervention designed to increase the use of research in health policy and program organisations (the SPIRIT study).” Implementation Science, vol. 9, no. 1, 2014, p. 113. https://doi.org/10.1186/s13012-014-0113-0.
Chicago
the CIPHER team, Abby S. Haynes, Sue Brennan, Stacy M. Carter, Denise A O’Connor, Carmen Huckel Schneider, Tari Turner, and Gisselle Gallego. 2014. “Protocol for the process evaluation of a complex intervention designed to increase the use of research in health policy and program organisations (the SPIRIT study).” Implementation Science 9 (1): 113. https://doi.org/10.1186/s13012-014-0113-0.
Harvard
the CIPHER team et al. (2014) ‘Protocol for the process evaluation of a complex intervention designed to increase the use of research in health policy and program organisations (the SPIRIT study)’, Implementation Science, 9(1), p. 113. doi:10.1186/s13012-014-0113-0.
IEEE
the CIPHER team et al., “Protocol for the process evaluation of a complex intervention designed to increase the use of research in health policy and program organisations (the SPIRIT study),” Implementation Science, vol. 9, no. 1, p. 113, 2014, doi: 10.1186/s13012-014-0113-0.
BibTeX
@article{thecipherteam2014protocol,
title = {{Protocol for the process evaluation of a complex intervention designed to increase the use of research in health policy and program organisations (the SPIRIT study)}},
author = {the CIPHER team and Haynes, Abby S. and Brennan, Sue and Carter, Stacy M. and O’Connor, Denise A and Schneider, Carmen Huckel and Turner, Tari and Gallego, Gisselle},
journal = {Implementation Science},
year = {2014},
volume = {9},
number = {1},
pages = {113},
doi = {10.1186/s13012-014-0113-0},
url = {https://doi.org/10.1186/s13012-014-0113-0}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2017 | 5 | |
| 2018 | 5 | |
| 2019 | 4 | |
| 2020 | 4 | |
| 2021 | 9 | |
| 2022 | 9 | |
| 2023 | 4 | |
| 2024 | 1 | |
| 2025 | 1 | |
| 2026 | 2 |
Its field-weighted citation impact is 3.88: it has been cited 3.88 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- process evaluation
- complex interventions
- research use in policy
- evidence-informed policy
- research capacity building
- implementation context
Work with this paper
Most-cited papers in Health Professions
- DETERMINATION OF SERUM PROTEINS BY MEANS OF THE BIURET REACTIONAllan Godfrey Gornall, Charles J. Bardawill, Maxima M. David · Journal of Biological Chemistry · 1949 · 16,172 citations
- Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation scienceLaura J. Damschroder, David Clark Aron, Rosalind E. Keith and 3 more · Implementation Science · 2009 · 15,527 citations
- FUNCTIONAL EVALUATION: THE BARTHEL INDEX.FLORENCE I. MAHONEY, DOROTHEA W. BARTHEL · PubMed · 1965 · 15,488 citations
- The Timed “Up & Go”: A Test of Basic Functional Mobility for Frail Elderly PersonsDiane Podsiadlo, Sandra Richardson · Journal of the American Geriatrics Society · 1991 · 15,001 citations
- National Committee for Clinical Laboratory StandardsErika Bruck · PEDIATRICS · 1980 · 14,735 citations
Questions about this paper
How do I cite this paper in APA style?
the CIPHER team, Haynes, A. S., Brennan, S., Carter, S. M., O’Connor, D. A., Schneider, C. H., Turner, T., & Gallego, G. (2014). Protocol for the process evaluation of a complex intervention designed to increase the use of research in health policy and program organisations (the SPIRIT study). Implementation Science, 9(1), 113. https://doi.org/10.1186/s13012-014-0113-0
How many times has this paper been cited?
48 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text at Implementation Science.
Who wrote this paper?
the CIPHER team, Abby S. Haynes, Sue Brennan, Stacy M. Carter, Denise A O’Connor, Carmen Huckel Schneider, Tari Turner, Gisselle Gallego.
What is the DOI of this paper?
10.1186/s13012-014-0113-0. The permanent link is https://doi.org/10.1186/s13012-014-0113-0.
Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.