Journal article · 2013 · Open access

Challenges to evaluating complex interventions: a content analysis of published papers

Jessica Datta, Mark Patrick Petticrew

BMC Public Health, 13(1), 568 · Published 11 June 2013 · DOI 10.1186/1471-2458-13-568

Free PDFView at the publisherCite this paper

In brief

“Challenges to evaluating complex interventions: a content analysis of published papers” is a 2013 journal article by Jessica Datta and Mark Patrick Petticrew, published in BMC Public Health. OpenAlex counts 284 citations as of 15 November 2026, which puts it in the top 1% of works published in 2013 by citations. It is open access under a CC BY licence: the full text is free to read at BMC Public Health.

Citations
284
Most cited in
2021 (35)
Field-weighted impact
23.68
References
202
Authors
2

Abstract

BACKGROUND: There is continuing interest among practitioners, policymakers and researchers in the evaluation of complex interventions stemming from the need to further develop the evidence base on the effectiveness of healthcare and public health interventions, and an awareness that evaluation becomes more challenging if interventions are complex.We undertook an analysis of published journal articles in order to identify aspects of complexity described by writers, the fields in which complex interventions are being evaluated and the challenges experienced in design, implementation and evaluation. This paper outlines the findings of this documentary analysis. METHODS: The PubMed electronic database was searched for the ten year period, January 2002 to December 2011, using the term "complex intervention*" in the title and/or abstract of a paper. We extracted text from papers to a table and carried out a thematic analysis to identify authors' descriptions of challenges faced in developing, implementing and evaluating complex interventions. RESULTS: The search resulted in a sample of 221 papers of which full text of 216 was obtained and 207 were included in the analysis. The 207 papers broadly cover clinical, public health and methodological topics. Challenges described included the content and standardisation of interventions, the impact of the people involved (staff and patients), the organisational context of implementation, the development of outcome measures, and evaluation. CONCLUSIONS: Our analysis of these papers suggests that more detailed reporting of information on outcomes, context and intervention is required for complex interventions. Future revisions to reporting guidelines for both primary and secondary research may need to take aspects of complexity into account to enhance their value to both researchers and users of research.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Datta, J., & Petticrew, M. P. (2013). Challenges to evaluating complex interventions: a content analysis of published papers. BMC Public Health, 13(1), 568. https://doi.org/10.1186/1471-2458-13-568

MLA 9

Datta, Jessica, and Mark Patrick Petticrew. “Challenges to evaluating complex interventions: a content analysis of published papers.” BMC Public Health, vol. 13, no. 1, 2013, p. 568. https://doi.org/10.1186/1471-2458-13-568.

Chicago

Datta, Jessica and Mark Patrick Petticrew. 2013. “Challenges to evaluating complex interventions: a content analysis of published papers.” BMC Public Health 13 (1): 568. https://doi.org/10.1186/1471-2458-13-568.

Harvard

Datta, J. and Petticrew, M. P. (2013) ‘Challenges to evaluating complex interventions: a content analysis of published papers’, BMC Public Health, 13(1), p. 568. doi:10.1186/1471-2458-13-568.

IEEE

J. Datta and M. P. Petticrew, “Challenges to evaluating complex interventions: a content analysis of published papers,” BMC Public Health, vol. 13, no. 1, p. 568, 2013, doi: 10.1186/1471-2458-13-568.

BibTeX

@article{datta2013challenges,
  title     = {{Challenges to evaluating complex interventions: a content analysis of published papers}},
  author    = {Datta, Jessica and Petticrew, Mark Patrick},
  journal   = {BMC Public Health},
  year      = {2013},
  volume    = {13},
  number    = {1},
  pages     = {568},
  doi       = {10.1186/1471-2458-13-568},
  url       = {https://doi.org/10.1186/1471-2458-13-568}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
20171414
20182020
20192424
20202020
20213535
20223131
20232121
20242828
20251717
20261515

Its field-weighted citation impact is 23.68: it has been cited 23.68 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science

  • complex interventions
  • intervention evaluation
  • assessment challenges
  • outcome measures
  • organizational context
  • reporting guidelines
  • intervention development
  • implementation

Work with this paper

Most-cited papers in Health Professions

All highly cited Health Professions papers

Questions about this paper

How do I cite this paper in APA style?

Datta, J., & Petticrew, M. P. (2013). Challenges to evaluating complex interventions: a content analysis of published papers. BMC Public Health, 13(1), 568. https://doi.org/10.1186/1471-2458-13-568

How many times has this paper been cited?

284 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at BMC Public Health.

Who wrote this paper?

Jessica Datta, Mark Patrick Petticrew.

What is the DOI of this paper?

10.1186/1471-2458-13-568. The permanent link is https://doi.org/10.1186/1471-2458-13-568.

Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.