Preprint · 2025 · Open access

A Powerful Random Forest Featuring Linear Extensions (RaFFLE)

Jakob Raymaekers, Peter J. Rousseeuw, Thomas Servotte, Tim Verdonck, Ruicong Yao

arXiv (Cornell University) · Published 14 February 2025 · DOI 10.48550/arxiv.2502.10185

Free PDFView at the publisherCite this paper

In brief

“A Powerful Random Forest Featuring Linear Extensions (RaFFLE)” is a 2025 preprint by Jakob Raymaekers and 4 co-authors, published in arXiv (Cornell University). OpenAlex counts 6 citations as of 16 November 2026. It is open access under a CC BY licence: the full text is free to read at arXiv (Cornell University).

Citations
6
Most cited in
2026 (4)
References
2
Authors
5

Abstract

Random forests are widely used in regression. However, the decision trees used as base learners are poor approximators of linear relationships. To address this limitation we propose RaFFLE (Random Forest Featuring Linear Extensions), a novel framework that integrates the recently developed PILOT trees (Piecewise Linear Organic Trees) as base learners within a random forest ensemble. PILOT trees combine the computational efficiency of traditional decision trees with the flexibility of linear model trees. To ensure sufficient diversity of the individual trees, we introduce an adjustable regularization parameter and use node-level feature sampling. These modifications improve the accuracy of the forest. We establish theoretical guarantees for the consistency of RaFFLE under weak conditions, and its faster convergence when the data are generated by a linear model. Empirical evaluations on 136 regression datasets demonstrate that RaFFLE outperforms the classical CART and random forest methods, the regularized linear methods Lasso and Ridge, and the state-of-the-art XGBoost algorithm, across both linear and nonlinear datasets. By balancing predictive accuracy and computational efficiency, RaFFLE proves to be a versatile tool for tackling a wide variety of regression problems.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Raymaekers, J., Rousseeuw, P. J., Servotte, T., Verdonck, T., & Yao, R. (2025). A Powerful Random Forest Featuring Linear Extensions (RaFFLE). arXiv (Cornell University). https://doi.org/10.48550/arxiv.2502.10185

MLA 9

Raymaekers, Jakob, et al. “A Powerful Random Forest Featuring Linear Extensions (RaFFLE).” arXiv (Cornell University), 2025. https://doi.org/10.48550/arxiv.2502.10185.

Chicago

Raymaekers, Jakob, Peter J. Rousseeuw, Thomas Servotte, Tim Verdonck, and Ruicong Yao. 2025. “A Powerful Random Forest Featuring Linear Extensions (RaFFLE).” arXiv (Cornell University). https://doi.org/10.48550/arxiv.2502.10185.

Harvard

Raymaekers, J. et al. (2025) ‘A Powerful Random Forest Featuring Linear Extensions (RaFFLE)’, arXiv (Cornell University). doi:10.48550/arxiv.2502.10185.

IEEE

J. Raymaekers, P. J. Rousseeuw, T. Servotte, T. Verdonck, and R. Yao, “A Powerful Random Forest Featuring Linear Extensions (RaFFLE),” arXiv (Cornell University), 2025, doi: 10.48550/arxiv.2502.10185.

BibTeX

@misc{raymaekers2025powerful,
  title     = {{A Powerful Random Forest Featuring Linear Extensions (RaFFLE)}},
  author    = {Raymaekers, Jakob and Rousseeuw, Peter J. and Servotte, Thomas and Verdonck, Tim and Yao, Ruicong},
  howpublished = {arXiv (Cornell University)},
  year      = {2025},
  doi       = {10.48550/arxiv.2502.10185},
  url       = {https://doi.org/10.48550/arxiv.2502.10185}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference

  • random forest
  • linear extensions
  • regression analysis
  • ensemble diversity
  • regularization
  • consistency guarantees
  • decision tree
  • XGBoost comparison

Work with this paper

Most-cited papers in Mathematics

All highly cited Mathematics papers

Questions about this paper

How do I cite this paper in APA style?

Raymaekers, J., Rousseeuw, P. J., Servotte, T., Verdonck, T., & Yao, R. (2025). A Powerful Random Forest Featuring Linear Extensions (RaFFLE). arXiv (Cornell University). https://doi.org/10.48550/arxiv.2502.10185

How many times has this paper been cited?

6 times, according to OpenAlex on 16 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at arXiv (Cornell University).

Who wrote this paper?

Jakob Raymaekers, Peter J. Rousseeuw, Thomas Servotte, Tim Verdonck, Ruicong Yao.

What is the DOI of this paper?

10.48550/arxiv.2502.10185. The permanent link is https://doi.org/10.48550/arxiv.2502.10185.

Bibliographic data from OpenAlex (CC0), last checked 16 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.