Journal article · 2021 · Open access

Increasing Precision without Altering Treatment Effects: Repeated Measures Designs in Survey Experiments

Scott Clifford, Geoffrey Sheagley, Spencer Piston

American Political Science Review, 115(3), 1048–1065 · Published 12 April 2021 · DOI 10.1017/s0003055421000241

Open PDFView at the publisherCite this paper

In brief

“Increasing Precision without Altering Treatment Effects: Repeated Measures Designs in Survey Experiments” is a 2021 journal article by Scott Clifford and 2 co-authors, published in American Political Science Review. OpenAlex counts 308 citations as of 21 November 2026, which puts it in the top 4% of works published in 2021 by citations. It is open access: the full text is free to read.

Citations
308
Most cited in
2025 (85)
Field-weighted impact
32.95
References
77
Authors
3

Abstract

The use of survey experiments has surged in political science. The most common design is the between-subjects design in which the outcome is only measured posttreatment. This design relies heavily on recruiting a large number of subjects to precisely estimate treatment effects. Alternative designs that involve repeated measurements of the dependent variable promise greater precision, but they are rarely used out of fears that these designs will yield different results than a standard design (e.g., due to consistency pressures). Across six studies, we assess this conventional wisdom by testing experimental designs against each other. Contrary to common fears, repeated measures designs tend to yield the same results as more common designs while substantially increasing precision. These designs also offer new insights into treatment effect size and heterogeneity. We conclude by encouraging researchers to adopt repeated measures designs and providing guidelines for when and how to use them.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Clifford, S., Sheagley, G., & Piston, S. (2021). Increasing Precision without Altering Treatment Effects: Repeated Measures Designs in Survey Experiments. American Political Science Review, 115(3), 1048–1065. https://doi.org/10.1017/s0003055421000241

MLA 9

Clifford, Scott, et al. “Increasing Precision without Altering Treatment Effects: Repeated Measures Designs in Survey Experiments.” American Political Science Review, vol. 115, no. 3, 2021, pp. 1048–1065. https://doi.org/10.1017/s0003055421000241.

Chicago

Clifford, Scott, Geoffrey Sheagley, and Spencer Piston. 2021. “Increasing Precision without Altering Treatment Effects: Repeated Measures Designs in Survey Experiments.” American Political Science Review 115 (3): 1048–1065. https://doi.org/10.1017/s0003055421000241.

Harvard

Clifford, S., Sheagley, G. and Piston, S. (2021) ‘Increasing Precision without Altering Treatment Effects: Repeated Measures Designs in Survey Experiments’, American Political Science Review, 115(3), pp. 1048–1065. doi:10.1017/s0003055421000241.

IEEE

S. Clifford, G. Sheagley, and S. Piston, “Increasing Precision without Altering Treatment Effects: Repeated Measures Designs in Survey Experiments,” American Political Science Review, vol. 115, no. 3, pp. 1048–1065, 2021, doi: 10.1017/s0003055421000241.

BibTeX

@article{clifford2021increasing,
  title     = {{Increasing Precision without Altering Treatment Effects: Repeated Measures Designs in Survey Experiments}},
  author    = {Clifford, Scott and Sheagley, Geoffrey and Piston, Spencer},
  journal   = {American Political Science Review},
  year      = {2021},
  volume    = {115},
  number    = {3},
  pages     = {1048--1065},
  doi       = {10.1017/s0003055421000241},
  url       = {https://doi.org/10.1017/s0003055421000241}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202044
20211111
20223030
20235454
20245252
20258585
20267272

Its field-weighted citation impact is 32.95: it has been cited 32.95 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Social Sciences › Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse

  • repeated measures designs
  • survey experiment
  • between-subjects design
  • measurement precision
  • treatment effect estimation
  • treatment effect heterogeneity
  • experimental design comparison

Work with this paper

Most-cited papers in Social Sciences

All highly cited Social Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Clifford, S., Sheagley, G., & Piston, S. (2021). Increasing Precision without Altering Treatment Effects: Repeated Measures Designs in Survey Experiments. American Political Science Review, 115(3), 1048–1065. https://doi.org/10.1017/s0003055421000241

How many times has this paper been cited?

308 times, according to OpenAlex on 21 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: sign in and open the PDF from this page.

Who wrote this paper?

Scott Clifford, Geoffrey Sheagley, Spencer Piston.

What is the DOI of this paper?

10.1017/s0003055421000241, permanently at https://doi.org/10.1017/s0003055421000241. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 21 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.