Journal article · 2022 · Open access

Trees, forests, chickens, and eggs: when and why to prune trees in a random forest

Siyu Zhou, Lucas Mentch

Statistical Analysis and Data Mining The ASA Data Science Journal, 16(1), 45–64 · Published 25 August 2022 · DOI 10.1002/sam.11594

Open PDFView at the publisherCite this paper

In brief

“Trees, forests, chickens, and eggs: when and why to prune trees in a random forest” is a 2022 journal article by Siyu Zhou and Lucas Mentch, published in Statistical Analysis and Data Mining The ASA Data Science Journal. OpenAlex counts 48 citations as of 22 November 2026, which puts it in the top 8% of works published in 2022 by citations. It is open access under a CC BY licence: the full text is free to read at arXiv (Cornell University).

Citations
48
Most cited in
2025 (13)
Field-weighted impact
4.35
References
49
Authors
2

Abstract

Due to their long‐standing reputation as excellent off‐the‐shelf predictors, random forests (RFs) continue to remain a go‐to model of choice for applied statisticians and data scientists. Despite their widespread use, however, until recently, little was known about their inner workings and about which aspects of the procedure were driving their success. Very recently, two competing hypotheses have emerged–one based on interpolation and the other based on regularization. This work argues in favor of the latter by utilizing the regularization framework to reexamine the decades‐old question of whether individual trees in an ensemble ought to be pruned. Despite the fact that default constructions of RFs use near full depth trees in most popular software packages, here we provide strong evidence that tree depth should be seen as a natural form of regularization across the entire procedure. In particular, our work suggests that RFs with shallow trees are advantageous when the signal‐to‐noise ratio in the data is low. In building up this argument, we also critique the newly popular notion of “double descent” in RFs by drawing parallels to U‐statistics and arguing that the noticeable jumps in random forest accuracy are the result of simple averaging rather than interpolation.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Zhou, S., & Mentch, L. (2022). Trees, forests, chickens, and eggs: when and why to prune trees in a random forest. Statistical Analysis and Data Mining The ASA Data Science Journal, 16(1), 45–64. https://doi.org/10.1002/sam.11594

MLA 9

Zhou, Siyu, and Lucas Mentch. “Trees, forests, chickens, and eggs: when and why to prune trees in a random forest.” Statistical Analysis and Data Mining The ASA Data Science Journal, vol. 16, no. 1, 2022, pp. 45–64. https://doi.org/10.1002/sam.11594.

Chicago

Zhou, Siyu and Lucas Mentch. 2022. “Trees, forests, chickens, and eggs: when and why to prune trees in a random forest.” Statistical Analysis and Data Mining The ASA Data Science Journal 16 (1): 45–64. https://doi.org/10.1002/sam.11594.

Harvard

Zhou, S. and Mentch, L. (2022) ‘Trees, forests, chickens, and eggs: when and why to prune trees in a random forest’, Statistical Analysis and Data Mining The ASA Data Science Journal, 16(1), pp. 45–64. doi:10.1002/sam.11594.

IEEE

S. Zhou and L. Mentch, “Trees, forests, chickens, and eggs: when and why to prune trees in a random forest,” Statistical Analysis and Data Mining The ASA Data Science Journal, vol. 16, no. 1, pp. 45–64, 2022, doi: 10.1002/sam.11594.

BibTeX

@article{zhou2022trees,
  title     = {{Trees, forests, chickens, and eggs: when and why to prune trees in a random forest}},
  author    = {Zhou, Siyu and Mentch, Lucas},
  journal   = {Statistical Analysis and Data Mining The ASA Data Science Journal},
  year      = {2022},
  volume    = {16},
  number    = {1},
  pages     = {45--64},
  doi       = {10.1002/sam.11594},
  url       = {https://doi.org/10.1002/sam.11594}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202122
202244
202366
20241212
20251313
20261111

Its field-weighted citation impact is 4.35: it has been cited 4.35 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference

  • random forest
  • tree pruning
  • tree depth
  • regularization
  • interpolation
  • double descent
  • U-statistics
  • signal-to-noise ratio

Work with this paper

Most-cited papers in Mathematics

All highly cited Mathematics papers

Questions about this paper

How do I cite this paper in APA style?

Zhou, S., & Mentch, L. (2022). Trees, forests, chickens, and eggs: when and why to prune trees in a random forest. Statistical Analysis and Data Mining The ASA Data Science Journal, 16(1), 45–64. https://doi.org/10.1002/sam.11594

How many times has this paper been cited?

48 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

Siyu Zhou, Lucas Mentch.

What is the DOI of this paper?

10.1002/sam.11594, permanently at https://doi.org/10.1002/sam.11594. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.