Journal article · 2022 · Open access

Quasi-experiments are a valuable source of evidence about effects of interventions, programs and policies: commentary from the Campbell Collaboration Study Design and Bias Assessment Working Group

Hugh Sharma Waddington, David B. Wilson, Terri Pigott, Gavin Bruce Stewart, Ariel M. Aloe, Peter Tugwell, Vivian Andrea Welch

Journal of Clinical Epidemiology, 152, 311–313 · Published 7 November 2022 · DOI 10.1016/j.jclinepi.2022.11.005

Free PDFView at the publisherCite this paper

In brief

“Quasi-experiments are a valuable source of evidence about effects of interventions, programs and policies: commentary from the Campbell Collaboration Study Design and Bias Assessment Working Group” is a 2022 journal article by Hugh Sharma Waddington and 6 co-authors, published in Journal of Clinical Epidemiology. OpenAlex counts 17 citations as of 15 November 2026. It is open access under a CC BY-NC-ND licence: the full text is free to read at Journal of Clinical Epidemiology.

Citations
17
Most cited in
2026 (6)
Field-weighted impact
0.82
References
12
Authors
7

Abstract

What is new?Key findings•Quasi-experimental designs (QEDs), also called nonrandomized studies of intervention effects, can provide evidence that is both internally and externally valid for decision making.What this adds to what is known•There are stronger theoretical and empirical reasons to incorporate QEDs in systematic reviews of intervention effects than are commonly acknowledged.What is the implication, what should change now•Systematic reviews of intervention effects should usually incorporate appropriately critically-appraised evidence from QEDs. Key findings•Quasi-experimental designs (QEDs), also called nonrandomized studies of intervention effects, can provide evidence that is both internally and externally valid for decision making.What this adds to what is known•There are stronger theoretical and empirical reasons to incorporate QEDs in systematic reviews of intervention effects than are commonly acknowledged.What is the implication, what should change now•Systematic reviews of intervention effects should usually incorporate appropriately critically-appraised evidence from QEDs. We have read with interest the guidelines paper by Saldanha and coauthors [[1]Saldanha I.J. Adam G.P. Bañez L.L. Bass E.B. Berliner E. Devine B. et al.Inclusion of nonrandomized studies of interventions in systematic reviews of interventions: updated guidance from the agency for Healthcare research and quality effective Healthcare program.J Clin Epidemiol. 2022; https://doi.org/10.1016/j.jclinepi.2022.08.015Abstract Full Text Full Text PDF Scopus (7) Google Scholar] for the Agency for Healthcare Research and Quality (AHRQ) Evidence-based Practice Center (EPC) Program. The paper aims to articulate the circumstances in which systematic reviews of health interventions should incorporate nonrandomized studies of interventions. These are studies that aim to demonstrate, and quantify, the causal effect of a defined treatment (an intervention, program, or policy) on a defined outcome, where the allocation to the treatment condition uses some method other than randomization. Examples of nonrandom allocation mechanisms include assignment based on a threshold on a pretest score, as in the case of the regression discontinuity design (RDD). Alternatively, participants may be selected by planners and practitioners using some other method (for example, by administrative jurisdiction), and/or it may simply be that study participants self-select into treatment, and the selection rules modelled in data analysis. The authors use the terminology “nonrandomized studies of interventions (NRSI)”, popularized in Sterne et al. [[2]Sterne J.A.C. Hernán M. Reeves B.C. Savović J. Berkman N.D. Viswanathan M. et al.ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions.Br Med J. 2016; 355: i4919Crossref PubMed Scopus (7536) Google Scholar], which incorporates nonrandomized studies of effects designed prospectively (that is, trials) or retrospectively (that is, observational studies). Following accepted terminology in the social sciences and related fields, we refer to these types of studies as…

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Waddington, H. S., Wilson, D. B., Pigott, T., Stewart, G. B., Aloe, A. M., Tugwell, P., & Welch, V. A. (2022). Quasi-experiments are a valuable source of evidence about effects of interventions, programs and policies: commentary from the Campbell Collaboration Study Design and Bias Assessment Working Group. Journal of Clinical Epidemiology, 152, 311–313. https://doi.org/10.1016/j.jclinepi.2022.11.005

MLA 9

Waddington, Hugh Sharma, et al. “Quasi-experiments are a valuable source of evidence about effects of interventions, programs and policies: commentary from the Campbell Collaboration Study Design and Bias Assessment Working Group.” Journal of Clinical Epidemiology, vol. 152, 2022, pp. 311–313. https://doi.org/10.1016/j.jclinepi.2022.11.005.

Chicago

Waddington, Hugh Sharma, David B. Wilson, Terri Pigott, Gavin Bruce Stewart, Ariel M. Aloe, Peter Tugwell, and Vivian Andrea Welch. 2022. “Quasi-experiments are a valuable source of evidence about effects of interventions, programs and policies: commentary from the Campbell Collaboration Study Design and Bias Assessment Working Group.” Journal of Clinical Epidemiology 152: 311–313. https://doi.org/10.1016/j.jclinepi.2022.11.005.

Harvard

Waddington, H. S. et al. (2022) ‘Quasi-experiments are a valuable source of evidence about effects of interventions, programs and policies: commentary from the Campbell Collaboration Study Design and Bias Assessment Working Group’, Journal of Clinical Epidemiology, 152, pp. 311–313. doi:10.1016/j.jclinepi.2022.11.005.

IEEE

H. S. Waddington et al., “Quasi-experiments are a valuable source of evidence about effects of interventions, programs and policies: commentary from the Campbell Collaboration Study Design and Bias Assessment Working Group,” Journal of Clinical Epidemiology, vol. 152, pp. 311–313, 2022, doi: 10.1016/j.jclinepi.2022.11.005.

BibTeX

@article{waddington2022quasi,
  title     = {{Quasi-experiments are a valuable source of evidence about effects of interventions, programs and policies: commentary from the Campbell Collaboration Study Design and Bias Assessment Working Group}},
  author    = {Waddington, Hugh Sharma and Wilson, David B. and Pigott, Terri and Stewart, Gavin Bruce and Aloe, Ariel M. and Tugwell, Peter and Welch, Vivian Andrea},
  journal   = {Journal of Clinical Epidemiology},
  year      = {2022},
  volume    = {152},
  pages     = {311--313},
  doi       = {10.1016/j.jclinepi.2022.11.005},
  url       = {https://doi.org/10.1016/j.jclinepi.2022.11.005}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202211
202311
202444
202555
202666

Its field-weighted citation impact is 0.82: it has been cited 0.82 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews

  • quasi-experimental design
  • internal validity
  • generalizability
  • bias assessment
  • regression discontinuity design
  • selection bias
  • self-selection
  • evidence-based practice centers

Work with this paper

Most-cited papers in Decision Sciences

All highly cited Decision Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Waddington, H. S., Wilson, D. B., Pigott, T., Stewart, G. B., Aloe, A. M., Tugwell, P., & Welch, V. A. (2022). Quasi-experiments are a valuable source of evidence about effects of interventions, programs and policies: commentary from the Campbell Collaboration Study Design and Bias Assessment Working Group. Journal of Clinical Epidemiology, 152, 311–313. https://doi.org/10.1016/j.jclinepi.2022.11.005

How many times has this paper been cited?

17 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at Journal of Clinical Epidemiology.

Who wrote this paper?

Hugh Sharma Waddington, David B. Wilson, Terri Pigott, Gavin Bruce Stewart, Ariel M. Aloe, Peter Tugwell, Vivian Andrea Welch.

What is the DOI of this paper?

10.1016/j.jclinepi.2022.11.005. The permanent link is https://doi.org/10.1016/j.jclinepi.2022.11.005.

Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.