Preprint · 2025 · Open access
A Powerful Random Forest Featuring Linear Extensions (RaFFLE)
arXiv (Cornell University) · Published 14 February 2025 · DOI 10.48550/arxiv.2502.10185
In brief
“A Powerful Random Forest Featuring Linear Extensions (RaFFLE)” is a 2025 preprint by Jakob Raymaekers and 4 co-authors, published in arXiv (Cornell University). OpenAlex counts 6 citations as of 16 November 2026. It is open access under a CC BY licence: the full text is free to read at arXiv (Cornell University).
- Citations
- 6
- Most cited in
- 2026 (4)
- References
- 2
- Authors
- 5
Abstract
Random forests are widely used in regression. However, the decision trees used as base learners are poor approximators of linear relationships. To address this limitation we propose RaFFLE (Random Forest Featuring Linear Extensions), a novel framework that integrates the recently developed PILOT trees (Piecewise Linear Organic Trees) as base learners within a random forest ensemble. PILOT trees combine the computational efficiency of traditional decision trees with the flexibility of linear model trees. To ensure sufficient diversity of the individual trees, we introduce an adjustable regularization parameter and use node-level feature sampling. These modifications improve the accuracy of the forest. We establish theoretical guarantees for the consistency of RaFFLE under weak conditions, and its faster convergence when the data are generated by a linear model. Empirical evaluations on 136 regression datasets demonstrate that RaFFLE outperforms the classical CART and random forest methods, the regularized linear methods Lasso and Ridge, and the state-of-the-art XGBoost algorithm, across both linear and nonlinear datasets. By balancing predictive accuracy and computational efficiency, RaFFLE proves to be a versatile tool for tackling a wide variety of regression problems.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Raymaekers, J., Rousseeuw, P. J., Servotte, T., Verdonck, T., & Yao, R. (2025). A Powerful Random Forest Featuring Linear Extensions (RaFFLE). arXiv (Cornell University). https://doi.org/10.48550/arxiv.2502.10185
MLA 9
Raymaekers, Jakob, et al. “A Powerful Random Forest Featuring Linear Extensions (RaFFLE).” arXiv (Cornell University), 2025. https://doi.org/10.48550/arxiv.2502.10185.
Chicago
Raymaekers, Jakob, Peter J. Rousseeuw, Thomas Servotte, Tim Verdonck, and Ruicong Yao. 2025. “A Powerful Random Forest Featuring Linear Extensions (RaFFLE).” arXiv (Cornell University). https://doi.org/10.48550/arxiv.2502.10185.
Harvard
Raymaekers, J. et al. (2025) ‘A Powerful Random Forest Featuring Linear Extensions (RaFFLE)’, arXiv (Cornell University). doi:10.48550/arxiv.2502.10185.
IEEE
J. Raymaekers, P. J. Rousseeuw, T. Servotte, T. Verdonck, and R. Yao, “A Powerful Random Forest Featuring Linear Extensions (RaFFLE),” arXiv (Cornell University), 2025, doi: 10.48550/arxiv.2502.10185.
BibTeX
@misc{raymaekers2025powerful,
title = {{A Powerful Random Forest Featuring Linear Extensions (RaFFLE)}},
author = {Raymaekers, Jakob and Rousseeuw, Peter J. and Servotte, Thomas and Verdonck, Tim and Yao, Ruicong},
howpublished = {arXiv (Cornell University)},
year = {2025},
doi = {10.48550/arxiv.2502.10185},
url = {https://doi.org/10.48550/arxiv.2502.10185}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference
- random forest
- linear extensions
- regression analysis
- ensemble diversity
- regularization
- consistency guarantees
- decision tree
- XGBoost comparison
Work with this paper
Most-cited papers in Mathematics
- Random ForestsLeo Breiman · Machine Learning · 2001 · 142,830 citations
- Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple TestingYoav Benjamini, Yosef Hochberg · Journal of the Royal Statistical Society Series B (Statistical Methodology) · 1995 · 113,923 citations
- Fitting Linear Mixed-Effects Models Using lme4Douglas M. Bates, Martin Maechler, Benjamin M. Bolker and 1 more · Journal of Statistical Software · 2015 · 100,328 citations
- The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations.Reuben M. Baron, David A. Kenny · Journal of Personality and Social Psychology · 1986 · 95,866 citations
- Using multivariate statisticsBarbara Gerson Tabachnick, Linda S. Fidell · 1983 · 79,867 citations
Questions about this paper
How do I cite this paper in APA style?
Raymaekers, J., Rousseeuw, P. J., Servotte, T., Verdonck, T., & Yao, R. (2025). A Powerful Random Forest Featuring Linear Extensions (RaFFLE). arXiv (Cornell University). https://doi.org/10.48550/arxiv.2502.10185
How many times has this paper been cited?
6 times, according to OpenAlex on 16 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text at arXiv (Cornell University).
Who wrote this paper?
Jakob Raymaekers, Peter J. Rousseeuw, Thomas Servotte, Tim Verdonck, Ruicong Yao.
What is the DOI of this paper?
10.48550/arxiv.2502.10185. The permanent link is https://doi.org/10.48550/arxiv.2502.10185.
Bibliographic data from OpenAlex (CC0), last checked 16 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.