Journal article · 2022 · Open access
Trees, forests, chickens, and eggs: when and why to prune trees in a random forest
Statistical Analysis and Data Mining The ASA Data Science Journal, 16(1), 45–64 · Published 25 August 2022 · DOI 10.1002/sam.11594
In brief
“Trees, forests, chickens, and eggs: when and why to prune trees in a random forest” is a 2022 journal article by Siyu Zhou and Lucas Mentch, published in Statistical Analysis and Data Mining The ASA Data Science Journal. OpenAlex counts 48 citations as of 22 November 2026, which puts it in the top 8% of works published in 2022 by citations. It is open access under a CC BY licence: the full text is free to read at arXiv (Cornell University).
- Citations
- 48
- Most cited in
- 2025 (13)
- Field-weighted impact
- 4.35
- References
- 49
- Authors
- 2
Abstract
Due to their long‐standing reputation as excellent off‐the‐shelf predictors, random forests (RFs) continue to remain a go‐to model of choice for applied statisticians and data scientists. Despite their widespread use, however, until recently, little was known about their inner workings and about which aspects of the procedure were driving their success. Very recently, two competing hypotheses have emerged–one based on interpolation and the other based on regularization. This work argues in favor of the latter by utilizing the regularization framework to reexamine the decades‐old question of whether individual trees in an ensemble ought to be pruned. Despite the fact that default constructions of RFs use near full depth trees in most popular software packages, here we provide strong evidence that tree depth should be seen as a natural form of regularization across the entire procedure. In particular, our work suggests that RFs with shallow trees are advantageous when the signal‐to‐noise ratio in the data is low. In building up this argument, we also critique the newly popular notion of “double descent” in RFs by drawing parallels to U‐statistics and arguing that the noticeable jumps in random forest accuracy are the result of simple averaging rather than interpolation.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Zhou, S., & Mentch, L. (2022). Trees, forests, chickens, and eggs: when and why to prune trees in a random forest. Statistical Analysis and Data Mining The ASA Data Science Journal, 16(1), 45–64. https://doi.org/10.1002/sam.11594
MLA 9
Zhou, Siyu, and Lucas Mentch. “Trees, forests, chickens, and eggs: when and why to prune trees in a random forest.” Statistical Analysis and Data Mining The ASA Data Science Journal, vol. 16, no. 1, 2022, pp. 45–64. https://doi.org/10.1002/sam.11594.
Chicago
Zhou, Siyu and Lucas Mentch. 2022. “Trees, forests, chickens, and eggs: when and why to prune trees in a random forest.” Statistical Analysis and Data Mining The ASA Data Science Journal 16 (1): 45–64. https://doi.org/10.1002/sam.11594.
Harvard
Zhou, S. and Mentch, L. (2022) ‘Trees, forests, chickens, and eggs: when and why to prune trees in a random forest’, Statistical Analysis and Data Mining The ASA Data Science Journal, 16(1), pp. 45–64. doi:10.1002/sam.11594.
IEEE
S. Zhou and L. Mentch, “Trees, forests, chickens, and eggs: when and why to prune trees in a random forest,” Statistical Analysis and Data Mining The ASA Data Science Journal, vol. 16, no. 1, pp. 45–64, 2022, doi: 10.1002/sam.11594.
BibTeX
@article{zhou2022trees,
title = {{Trees, forests, chickens, and eggs: when and why to prune trees in a random forest}},
author = {Zhou, Siyu and Mentch, Lucas},
journal = {Statistical Analysis and Data Mining The ASA Data Science Journal},
year = {2022},
volume = {16},
number = {1},
pages = {45--64},
doi = {10.1002/sam.11594},
url = {https://doi.org/10.1002/sam.11594}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2021 | 2 | |
| 2022 | 4 | |
| 2023 | 6 | |
| 2024 | 12 | |
| 2025 | 13 | |
| 2026 | 11 |
Its field-weighted citation impact is 4.35: it has been cited 4.35 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference
- random forest
- tree pruning
- tree depth
- regularization
- interpolation
- double descent
- U-statistics
- signal-to-noise ratio
Work with this paper
Most-cited papers in Mathematics
- Random ForestsLeo Breiman · Machine Learning · 2001 · 142,830 citations
- Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple TestingYoav Benjamini, Yosef Hochberg · Journal of the Royal Statistical Society Series B (Statistical Methodology) · 1995 · 113,923 citations
- Fitting Linear Mixed-Effects Models Using lme4Douglas M. Bates, Martin Maechler, Benjamin M. Bolker and 1 more · Journal of Statistical Software · 2015 · 100,328 citations
- The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations.Reuben M. Baron, David A. Kenny · Journal of Personality and Social Psychology · 1986 · 95,866 citations
- Using multivariate statisticsBarbara Gerson Tabachnick, Linda S. Fidell · 1983 · 79,867 citations
Questions about this paper
How do I cite this paper in APA style?
Zhou, S., & Mentch, L. (2022). Trees, forests, chickens, and eggs: when and why to prune trees in a random forest. Statistical Analysis and Data Mining The ASA Data Science Journal, 16(1), 45–64. https://doi.org/10.1002/sam.11594
How many times has this paper been cited?
48 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.
Who wrote this paper?
Siyu Zhou, Lucas Mentch.
What is the DOI of this paper?
10.1002/sam.11594, permanently at https://doi.org/10.1002/sam.11594. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.