Journal article · 2007 · Open access
Control of generalized error rates in multiple testing
The Annals of Statistics, 35(4), 1378–1408 · Published 1 August 2007 · DOI 10.1214/009053606000001622
In brief
“Control of generalized error rates in multiple testing” is a 2007 journal article by Joseph P. Romano and Michael Wolf, published in The Annals of Statistics. OpenAlex counts 171 citations as of 15 November 2026, which puts it in the top 3% of works published in 2007 by citations. It is open access: the full text is free to read at The Annals of Statistics.
- Citations
- 171
- Most cited in
- 2018 (14)
- Field-weighted impact
- 8.39
- References
- 40
- Authors
- 2
Abstract
Consider the problem of testing $s$ hypotheses simultaneously. The usual approach restricts attention to procedures that control the probability of even one false rejection, the familywise error rate (FWER). If $s$ is large, one might be willing to tolerate more than one false rejection, thereby increasing the ability of the procedure to correctly reject false null hypotheses. One possibility is to replace control of the FWER by control of the probability of $k$ or more false rejections, which is called the $k$-FWER. We derive both single-step and step-down procedures that control the $k$-FWER in finite samples or asymptotically, depending on the situation. We also consider the false discovery proportion (FDP) defined as the number of false rejections divided by the total number of rejections (and defined to be 0 if there are no rejections). The false discovery rate proposed by Benjamini and Hochberg [J. Roy. Statist. Soc. Ser. B 57 (1995) 289–300] controls $E$(FDP). Here, the goal is to construct methods which satisfy, for a given $γ$ and $α$, $P\{\mathrm{FDP} \gt γ\} ≤ α$, at least asymptotically. In contrast to the proposals of Lehmann and Romano [Ann. Statist. 33 (2005) 1138–1154], we construct methods that implicitly take into account the dependence structure of the individual test statistics in order to further increase the ability to detect false null hypotheses. This feature is also shared by related work of van der Laan, Dudoit and Pollard [Stat. Appl. Genet. Mol. Biol. 3 (2004) article 15], but our methodology is quite different. Like the work of Pollard and van der Laan [Proc. 2003 International Multi-Conference in Computer Science and Engineering, METMBS’03 Conference (2003) 3–9] and Dudoit, van der Laan and Pollard [Stat. Appl. Genet. Mol. Biol. 3 (2004) article 13], we employ resampling methods to achieve our goals. Some simulations compare finite sample performance to currently available methods.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Romano, J. P., & Wolf, M. (2007). Control of generalized error rates in multiple testing. The Annals of Statistics, 35(4), 1378–1408. https://doi.org/10.1214/009053606000001622
MLA 9
Romano, Joseph P., and Michael Wolf. “Control of generalized error rates in multiple testing.” The Annals of Statistics, vol. 35, no. 4, 2007, pp. 1378–1408. https://doi.org/10.1214/009053606000001622.
Chicago
Romano, Joseph P. and Michael Wolf. 2007. “Control of generalized error rates in multiple testing.” The Annals of Statistics 35 (4): 1378–1408. https://doi.org/10.1214/009053606000001622.
Harvard
Romano, J. P. and Wolf, M. (2007) ‘Control of generalized error rates in multiple testing’, The Annals of Statistics, 35(4), pp. 1378–1408. doi:10.1214/009053606000001622.
IEEE
J. P. Romano and M. Wolf, “Control of generalized error rates in multiple testing,” The Annals of Statistics, vol. 35, no. 4, pp. 1378–1408, 2007, doi: 10.1214/009053606000001622.
BibTeX
@article{romano2007control,
title = {{Control of generalized error rates in multiple testing}},
author = {Romano, Joseph P. and Wolf, Michael},
journal = {The Annals of Statistics},
year = {2007},
volume = {35},
number = {4},
pages = {1378--1408},
doi = {10.1214/009053606000001622},
url = {https://doi.org/10.1214/009053606000001622}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2017 | 8 | |
| 2018 | 14 | |
| 2019 | 9 | |
| 2020 | 12 | |
| 2021 | 9 | |
| 2022 | 8 | |
| 2023 | 10 | |
| 2024 | 5 | |
| 2025 | 9 | |
| 2026 | 7 |
Its field-weighted citation impact is 8.39: it has been cited 8.39 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- multiple comparisons
- false discovery proportion
- false discovery rate
- step-down procedures
- single-step procedure
- resampling
- asymptotic control
Work with this paper
Most-cited papers in Mathematics
- Random ForestsLeo Breiman · Machine Learning · 2001 · 142,830 citations
- Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple TestingYoav Benjamini, Yosef Hochberg · Journal of the Royal Statistical Society Series B (Statistical Methodology) · 1995 · 113,923 citations
- Fitting Linear Mixed-Effects Models Using lme4Douglas M. Bates, Martin Maechler, Benjamin M. Bolker and 1 more · Journal of Statistical Software · 2015 · 100,328 citations
- The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations.Reuben M. Baron, David A. Kenny · Journal of Personality and Social Psychology · 1986 · 95,866 citations
- Using multivariate statisticsBarbara Gerson Tabachnick, Linda S. Fidell · 1983 · 79,867 citations
Questions about this paper
How do I cite this paper in APA style?
Romano, J. P., & Wolf, M. (2007). Control of generalized error rates in multiple testing. The Annals of Statistics, 35(4), 1378–1408. https://doi.org/10.1214/009053606000001622
How many times has this paper been cited?
171 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text at The Annals of Statistics.
Who wrote this paper?
Joseph P. Romano, Michael Wolf.
What is the DOI of this paper?
10.1214/009053606000001622. The permanent link is https://doi.org/10.1214/009053606000001622.
Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.