Journal article · 2021 · Open access
Increasing Precision without Altering Treatment Effects: Repeated Measures Designs in Survey Experiments
American Political Science Review, 115(3), 1048–1065 · Published 12 April 2021 · DOI 10.1017/s0003055421000241
In brief
“Increasing Precision without Altering Treatment Effects: Repeated Measures Designs in Survey Experiments” is a 2021 journal article by Scott Clifford and 2 co-authors, published in American Political Science Review. OpenAlex counts 308 citations as of 21 November 2026, which puts it in the top 4% of works published in 2021 by citations. It is open access: the full text is free to read.
- Citations
- 308
- Most cited in
- 2025 (85)
- Field-weighted impact
- 32.95
- References
- 77
- Authors
- 3
Abstract
The use of survey experiments has surged in political science. The most common design is the between-subjects design in which the outcome is only measured posttreatment. This design relies heavily on recruiting a large number of subjects to precisely estimate treatment effects. Alternative designs that involve repeated measurements of the dependent variable promise greater precision, but they are rarely used out of fears that these designs will yield different results than a standard design (e.g., due to consistency pressures). Across six studies, we assess this conventional wisdom by testing experimental designs against each other. Contrary to common fears, repeated measures designs tend to yield the same results as more common designs while substantially increasing precision. These designs also offer new insights into treatment effect size and heterogeneity. We conclude by encouraging researchers to adopt repeated measures designs and providing guidelines for when and how to use them.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Clifford, S., Sheagley, G., & Piston, S. (2021). Increasing Precision without Altering Treatment Effects: Repeated Measures Designs in Survey Experiments. American Political Science Review, 115(3), 1048–1065. https://doi.org/10.1017/s0003055421000241
MLA 9
Clifford, Scott, et al. “Increasing Precision without Altering Treatment Effects: Repeated Measures Designs in Survey Experiments.” American Political Science Review, vol. 115, no. 3, 2021, pp. 1048–1065. https://doi.org/10.1017/s0003055421000241.
Chicago
Clifford, Scott, Geoffrey Sheagley, and Spencer Piston. 2021. “Increasing Precision without Altering Treatment Effects: Repeated Measures Designs in Survey Experiments.” American Political Science Review 115 (3): 1048–1065. https://doi.org/10.1017/s0003055421000241.
Harvard
Clifford, S., Sheagley, G. and Piston, S. (2021) ‘Increasing Precision without Altering Treatment Effects: Repeated Measures Designs in Survey Experiments’, American Political Science Review, 115(3), pp. 1048–1065. doi:10.1017/s0003055421000241.
IEEE
S. Clifford, G. Sheagley, and S. Piston, “Increasing Precision without Altering Treatment Effects: Repeated Measures Designs in Survey Experiments,” American Political Science Review, vol. 115, no. 3, pp. 1048–1065, 2021, doi: 10.1017/s0003055421000241.
BibTeX
@article{clifford2021increasing,
title = {{Increasing Precision without Altering Treatment Effects: Repeated Measures Designs in Survey Experiments}},
author = {Clifford, Scott and Sheagley, Geoffrey and Piston, Spencer},
journal = {American Political Science Review},
year = {2021},
volume = {115},
number = {3},
pages = {1048--1065},
doi = {10.1017/s0003055421000241},
url = {https://doi.org/10.1017/s0003055421000241}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2020 | 4 | |
| 2021 | 11 | |
| 2022 | 30 | |
| 2023 | 54 | |
| 2024 | 52 | |
| 2025 | 85 | |
| 2026 | 72 |
Its field-weighted citation impact is 32.95: it has been cited 32.95 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Social Sciences › Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- repeated measures designs
- survey experiment
- between-subjects design
- measurement precision
- treatment effect estimation
- treatment effect heterogeneity
- experimental design comparison
Work with this paper
Most-cited papers in Social Sciences
- Using thematic analysis in psychologyVirginia Braun, Victoria Clarke · Qualitative Research in Psychology · 2006 · 240,222 citations
- Case Study Research: Design and MethodsRobert K. Yin · 1984 · 81,951 citations
- Three Approaches to Qualitative Content AnalysisHsiu-Fang Hsieh, Sarah Elizabeth Shannon · Qualitative Health Research · 2005 · 49,623 citations
- Qualitative Data Analysis: An Expanded SourcebookMatthew B. Miles, A Michael Huberman · Journal of Environmental Psychology · 1994 · 48,311 citations
- Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groupsAllison Tong, Peter Sainsbury, Jonathan C. Craig · International Journal for Quality in Health Care · 2007 · 45,353 citations
Questions about this paper
How do I cite this paper in APA style?
Clifford, S., Sheagley, G., & Piston, S. (2021). Increasing Precision without Altering Treatment Effects: Repeated Measures Designs in Survey Experiments. American Political Science Review, 115(3), 1048–1065. https://doi.org/10.1017/s0003055421000241
How many times has this paper been cited?
308 times, according to OpenAlex on 21 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: sign in and open the PDF from this page.
Who wrote this paper?
Scott Clifford, Geoffrey Sheagley, Spencer Piston.
What is the DOI of this paper?
10.1017/s0003055421000241, permanently at https://doi.org/10.1017/s0003055421000241. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 21 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.