Journal article · 2021 · Open access

Framework for the development and evaluation of complex interventions: gap analysis, workshop and consultation-informed update

Kathryn Skivington, Lynsay Matthews, Sharon Anne Simpson, Peter Craig, Janis Baird, Jane M. Blazeby, Kathleen Boyd, Neil J. Craig, David French, Emma McIntosh, Mark Patrick Petticrew, Jo Rycroft‐Malone and 2 more

Health Technology Assessment, 25(57), 1–132 · Published 1 September 2021 · DOI 10.3310/hta25570

Free PDFView at the publisherCite this paper

In brief

“Framework for the development and evaluation of complex interventions: gap analysis, workshop and consultation-informed update” is a 2021 journal article by Kathryn Skivington and 13 co-authors, published in Health Technology Assessment. OpenAlex counts 607 citations as of 15 November 2026, which puts it in the top 2% of works published in 2021 by citations. It is open access under a CC BY-NC licence: the full text is free to read at Health Technology Assessment.

Citations
607
Most cited in
2024 (152)
Field-weighted impact
78.26
References
340
Authors
14

Abstract

BACKGROUND: The Medical Research Council published the second edition of its framework in 2006 on developing and evaluating complex interventions. Since then, there have been considerable developments in the field of complex intervention research. The objective of this project was to update the framework in the light of these developments. The framework aims to help research teams prioritise research questions and design, and conduct research with an appropriate choice of methods, rather than to provide detailed guidance on the use of specific methods. METHODS: There were four stages to the update: (1) gap analysis to identify developments in the methods and practice since the previous framework was published; (2) an expert workshop of 36 participants to discuss the topics identified in the gap analysis; (3) an open consultation process to seek comments on a first draft of the new framework; and (4) findings from the previous stages were used to redraft the framework, and final expert review was obtained. The process was overseen by a Scientific Advisory Group representing the range of relevant National Institute for Health Research and Medical Research Council research investments. RESULTS: Key changes to the previous framework include (1) an updated definition of complex interventions, highlighting the dynamic relationship between the intervention and its context; (2) an emphasis on the use of diverse research perspectives: efficacy, effectiveness, theory-based and systems perspectives; (3) a focus on the usefulness of evidence as the basis for determining research perspective and questions; (4) an increased focus on interventions developed outside research teams, for example changes in policy or health services delivery; and (5) the identification of six 'core elements' that should guide all phases of complex intervention research: consider context; develop, refine and test programme theory; engage stakeholders; identify key uncertainties; refine the intervention; and economic considerations. We divide the research process into four phases: development, feasibility, evaluation and implementation. For each phase we provide a concise summary of recent developments, key points to address and signposts to further reading. We also present case studies to illustrate the points being made throughout. LIMITATIONS: The framework aims to help research teams prioritise research questions and design and conduct research with an appropriate choice of methods, rather than to provide detailed guidance on the use of specific methods. In many of the areas of innovation that we highlight, such as the use of systems approaches, there are still only a few practical examples. We refer to more specific and detailed guidance where available and note where promising approaches require further development. CONCLUSIONS…

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Skivington, K., Matthews, L., Simpson, S. A., Craig, P., Baird, J., Blazeby, J. M., Boyd, K., Craig, N. J., French, D., McIntosh, E., Petticrew, M. P., Rycroft‐Malone, J., White, M. J., & Moore, L. (2021). Framework for the development and evaluation of complex interventions: gap analysis, workshop and consultation-informed update. Health Technology Assessment, 25(57), 1–132. https://doi.org/10.3310/hta25570

MLA 9

Skivington, Kathryn, et al. “Framework for the development and evaluation of complex interventions: gap analysis, workshop and consultation-informed update.” Health Technology Assessment, vol. 25, no. 57, 2021, pp. 1–132. https://doi.org/10.3310/hta25570.

Chicago

Skivington, Kathryn, Lynsay Matthews, Sharon Anne Simpson, Peter Craig, Janis Baird, Jane M. Blazeby, Kathleen Boyd, et al. 2021. “Framework for the development and evaluation of complex interventions: gap analysis, workshop and consultation-informed update.” Health Technology Assessment 25 (57): 1–132. https://doi.org/10.3310/hta25570.

Harvard

Skivington, K. et al. (2021) ‘Framework for the development and evaluation of complex interventions: gap analysis, workshop and consultation-informed update’, Health Technology Assessment, 25(57), pp. 1–132. doi:10.3310/hta25570.

IEEE

K. Skivington et al., “Framework for the development and evaluation of complex interventions: gap analysis, workshop and consultation-informed update,” Health Technology Assessment, vol. 25, no. 57, pp. 1–132, 2021, doi: 10.3310/hta25570.

BibTeX

@article{skivington2021framework,
  title     = {{Framework for the development and evaluation of complex interventions: gap analysis, workshop and consultation-informed update}},
  author    = {Skivington, Kathryn and Matthews, Lynsay and Simpson, Sharon Anne and Craig, Peter and Baird, Janis and Blazeby, Jane M. and Boyd, Kathleen and Craig, Neil J. and French, David and McIntosh, Emma and Petticrew, Mark Patrick and Rycroft‐Malone, Jo and White, Martin J. and Moore, Laurence},
  journal   = {Health Technology Assessment},
  year      = {2021},
  volume    = {25},
  number    = {57},
  pages     = {1--132},
  doi       = {10.3310/hta25570},
  url       = {https://doi.org/10.3310/hta25570}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202199
20228686
2023106106
2024152152
2025134134
2026120120

Its field-weighted citation impact is 78.26: it has been cited 78.26 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science

  • complex interventions
  • intervention development
  • intervention evaluation
  • program theory
  • systems approach
  • stakeholder engagement
  • feasibility study
  • implementation research

Work with this paper

Most-cited papers in Health Professions

All highly cited Health Professions papers

Questions about this paper

How do I cite this paper in APA style?

Skivington, K., Matthews, L., Simpson, S. A., Craig, P., Baird, J., Blazeby, J. M., Boyd, K., Craig, N. J., French, D., McIntosh, E., Petticrew, M. P., Rycroft‐Malone, J., White, M. J., & Moore, L. (2021). Framework for the development and evaluation of complex interventions: gap analysis, workshop and consultation-informed update. Health Technology Assessment, 25(57), 1–132. https://doi.org/10.3310/hta25570

How many times has this paper been cited?

607 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at Health Technology Assessment.

Who wrote this paper?

Kathryn Skivington, Lynsay Matthews, Sharon Anne Simpson, Peter Craig, Janis Baird, Jane M. Blazeby, Kathleen Boyd, Neil J. Craig, David French, Emma McIntosh, Mark Patrick Petticrew, Jo Rycroft‐Malone and 2 more.

What is the DOI of this paper?

10.3310/hta25570. The permanent link is https://doi.org/10.3310/hta25570.

Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.