Preprint · 2019 · Open access
Regression-Enhanced Random Forests
arXiv (Cornell University), 636–647 · Published 23 April 2019 · DOI 10.48550/arxiv.1904.10416
In brief
“Regression-Enhanced Random Forests” is a 2019 preprint by Haozhe Zhang and 2 co-authors, published in arXiv (Cornell University). OpenAlex counts 82 citations as of 16 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).
- Citations
- 82
- Most cited in
- 2024 (22)
- References
- 19
- Authors
- 3
Abstract
Random forest (RF) methodology is one of the most popular machine learning techniques for prediction problems. In this article, we discuss some cases where random forests may suffer and propose a novel generalized RF method, namely regression-enhanced random forests (RERFs), that can improve on RFs by borrowing the strength of penalized parametric regression. The algorithm for constructing RERFs and selecting its tuning parameters is described. Both simulation study and real data examples show that RERFs have better predictive performance than RFs in important situations often encountered in practice. Moreover, RERFs may incorporate known relationships between the response and the predictors, and may give reliable predictions in extrapolation problems where predictions are required at points out of the domain of the training dataset. Strategies analogous to those described here can be used to improve other machine learning methods via combination with penalized parametric regression techniques.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Zhang, H., Nettleton, D. S., & Zhu, Z. (2019). Regression-Enhanced Random Forests. arXiv (Cornell University), 636–647. https://doi.org/10.48550/arxiv.1904.10416
MLA 9
Zhang, Haozhe, et al. “Regression-Enhanced Random Forests.” arXiv (Cornell University), 2019, pp. 636–647. https://doi.org/10.48550/arxiv.1904.10416.
Chicago
Zhang, Haozhe, Dan S. Nettleton, and Zhengyuan Zhu. 2019. “Regression-Enhanced Random Forests.” arXiv (Cornell University): 636–647. https://doi.org/10.48550/arxiv.1904.10416.
Harvard
Zhang, H., Nettleton, D. S. and Zhu, Z. (2019) ‘Regression-Enhanced Random Forests’, arXiv (Cornell University), pp. 636–647. doi:10.48550/arxiv.1904.10416.
IEEE
H. Zhang, D. S. Nettleton, and Z. Zhu, “Regression-Enhanced Random Forests,” arXiv (Cornell University), pp. 636–647, 2019, doi: 10.48550/arxiv.1904.10416.
BibTeX
@misc{zhang2019regression,
title = {{Regression-Enhanced Random Forests}},
author = {Zhang, Haozhe and Nettleton, Dan S. and Zhu, Zhengyuan},
howpublished = {arXiv (Cornell University)},
year = {2019},
pages = {636--647},
doi = {10.48550/arxiv.1904.10416},
url = {https://doi.org/10.48550/arxiv.1904.10416}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2020 | 2 | |
| 2021 | 6 | |
| 2022 | 10 | |
| 2023 | 21 | |
| 2024 | 22 | |
| 2025 | 11 | |
| 2026 | 10 |
Topic and keywords
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference
- random forest
- ensemble boosting
- hyperparameter optimization
- extrapolation
- predictive performance
Work with this paper
Most-cited papers in Mathematics
- Random ForestsLeo Breiman · Machine Learning · 2001 · 142,830 citations
- Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple TestingYoav Benjamini, Yosef Hochberg · Journal of the Royal Statistical Society Series B (Statistical Methodology) · 1995 · 113,923 citations
- Fitting Linear Mixed-Effects Models Using lme4Douglas M. Bates, Martin Maechler, Benjamin M. Bolker and 1 more · Journal of Statistical Software · 2015 · 100,328 citations
- The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations.Reuben M. Baron, David A. Kenny · Journal of Personality and Social Psychology · 1986 · 95,866 citations
- Using multivariate statisticsBarbara Gerson Tabachnick, Linda S. Fidell · 1983 · 79,867 citations
Questions about this paper
How do I cite this paper in APA style?
Zhang, H., Nettleton, D. S., & Zhu, Z. (2019). Regression-Enhanced Random Forests. arXiv (Cornell University), 636–647. https://doi.org/10.48550/arxiv.1904.10416
How many times has this paper been cited?
82 times, according to OpenAlex on 16 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text at arXiv (Cornell University).
Who wrote this paper?
Haozhe Zhang, Dan S. Nettleton, Zhengyuan Zhu.
What is the DOI of this paper?
10.48550/arxiv.1904.10416. The permanent link is https://doi.org/10.48550/arxiv.1904.10416.
Bibliographic data from OpenAlex (CC0), last checked 16 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.