Journal article · 2013 · Open access
Challenges to evaluating complex interventions: a content analysis of published papers
BMC Public Health, 13(1), 568 · Published 11 June 2013 · DOI 10.1186/1471-2458-13-568
In brief
“Challenges to evaluating complex interventions: a content analysis of published papers” is a 2013 journal article by Jessica Datta and Mark Patrick Petticrew, published in BMC Public Health. OpenAlex counts 284 citations as of 15 November 2026, which puts it in the top 1% of works published in 2013 by citations. It is open access under a CC BY licence: the full text is free to read at BMC Public Health.
- Citations
- 284
- Most cited in
- 2021 (35)
- Field-weighted impact
- 23.68
- References
- 202
- Authors
- 2
Abstract
BACKGROUND: There is continuing interest among practitioners, policymakers and researchers in the evaluation of complex interventions stemming from the need to further develop the evidence base on the effectiveness of healthcare and public health interventions, and an awareness that evaluation becomes more challenging if interventions are complex.We undertook an analysis of published journal articles in order to identify aspects of complexity described by writers, the fields in which complex interventions are being evaluated and the challenges experienced in design, implementation and evaluation. This paper outlines the findings of this documentary analysis. METHODS: The PubMed electronic database was searched for the ten year period, January 2002 to December 2011, using the term "complex intervention*" in the title and/or abstract of a paper. We extracted text from papers to a table and carried out a thematic analysis to identify authors' descriptions of challenges faced in developing, implementing and evaluating complex interventions. RESULTS: The search resulted in a sample of 221 papers of which full text of 216 was obtained and 207 were included in the analysis. The 207 papers broadly cover clinical, public health and methodological topics. Challenges described included the content and standardisation of interventions, the impact of the people involved (staff and patients), the organisational context of implementation, the development of outcome measures, and evaluation. CONCLUSIONS: Our analysis of these papers suggests that more detailed reporting of information on outcomes, context and intervention is required for complex interventions. Future revisions to reporting guidelines for both primary and secondary research may need to take aspects of complexity into account to enhance their value to both researchers and users of research.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Datta, J., & Petticrew, M. P. (2013). Challenges to evaluating complex interventions: a content analysis of published papers. BMC Public Health, 13(1), 568. https://doi.org/10.1186/1471-2458-13-568
MLA 9
Datta, Jessica, and Mark Patrick Petticrew. “Challenges to evaluating complex interventions: a content analysis of published papers.” BMC Public Health, vol. 13, no. 1, 2013, p. 568. https://doi.org/10.1186/1471-2458-13-568.
Chicago
Datta, Jessica and Mark Patrick Petticrew. 2013. “Challenges to evaluating complex interventions: a content analysis of published papers.” BMC Public Health 13 (1): 568. https://doi.org/10.1186/1471-2458-13-568.
Harvard
Datta, J. and Petticrew, M. P. (2013) ‘Challenges to evaluating complex interventions: a content analysis of published papers’, BMC Public Health, 13(1), p. 568. doi:10.1186/1471-2458-13-568.
IEEE
J. Datta and M. P. Petticrew, “Challenges to evaluating complex interventions: a content analysis of published papers,” BMC Public Health, vol. 13, no. 1, p. 568, 2013, doi: 10.1186/1471-2458-13-568.
BibTeX
@article{datta2013challenges,
title = {{Challenges to evaluating complex interventions: a content analysis of published papers}},
author = {Datta, Jessica and Petticrew, Mark Patrick},
journal = {BMC Public Health},
year = {2013},
volume = {13},
number = {1},
pages = {568},
doi = {10.1186/1471-2458-13-568},
url = {https://doi.org/10.1186/1471-2458-13-568}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2017 | 14 | |
| 2018 | 20 | |
| 2019 | 24 | |
| 2020 | 20 | |
| 2021 | 35 | |
| 2022 | 31 | |
| 2023 | 21 | |
| 2024 | 28 | |
| 2025 | 17 | |
| 2026 | 15 |
Its field-weighted citation impact is 23.68: it has been cited 23.68 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- complex interventions
- intervention evaluation
- assessment challenges
- outcome measures
- organizational context
- reporting guidelines
- intervention development
- implementation
Work with this paper
Most-cited papers in Health Professions
- DETERMINATION OF SERUM PROTEINS BY MEANS OF THE BIURET REACTIONAllan Godfrey Gornall, Charles J. Bardawill, Maxima M. David · Journal of Biological Chemistry · 1949 · 16,172 citations
- Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation scienceLaura J. Damschroder, David Clark Aron, Rosalind E. Keith and 3 more · Implementation Science · 2009 · 15,527 citations
- FUNCTIONAL EVALUATION: THE BARTHEL INDEX.FLORENCE I. MAHONEY, DOROTHEA W. BARTHEL · PubMed · 1965 · 15,488 citations
- The Timed “Up & Go”: A Test of Basic Functional Mobility for Frail Elderly PersonsDiane Podsiadlo, Sandra Richardson · Journal of the American Geriatrics Society · 1991 · 15,001 citations
- National Committee for Clinical Laboratory StandardsErika Bruck · PEDIATRICS · 1980 · 14,735 citations
Questions about this paper
How do I cite this paper in APA style?
Datta, J., & Petticrew, M. P. (2013). Challenges to evaluating complex interventions: a content analysis of published papers. BMC Public Health, 13(1), 568. https://doi.org/10.1186/1471-2458-13-568
How many times has this paper been cited?
284 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text at BMC Public Health.
Who wrote this paper?
Jessica Datta, Mark Patrick Petticrew.
What is the DOI of this paper?
10.1186/1471-2458-13-568. The permanent link is https://doi.org/10.1186/1471-2458-13-568.
Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.