Preprint · 2024 · Open access
Optimal Mixed Integer Linear Optimization Trained Multivariate Classification Trees
arXiv (Cornell University) · Published 2 August 2024 · DOI 10.48550/arxiv.2408.01297
In brief
“Optimal Mixed Integer Linear Optimization Trained Multivariate Classification Trees” is a 2024 preprint by Brandon Alston and Illya V. Hicks, published in arXiv (Cornell University). OpenAlex counts 0 citations as of 19 November 2026. It is open access under a CC BY licence: the full text is free to read at arXiv (Cornell University).
- Citations
- 0
- References
- 48
- Authors
- 2
Abstract
Multivariate decision trees are powerful machine learning tools for classification and regression that attract many researchers and industry professionals. An optimal binary tree has two types of vertices, (i) branching vertices which have exactly two children and where datapoints are assessed on a set of discrete features and (ii) leaf vertices at which datapoints are given a prediction, and can be obtained by solving a biobjective optimization problem that seeks to (i) maximize the number of correctly classified datapoints and (ii) minimize the number of branching vertices. Branching vertices are linear combinations of training features and therefore can be thought of as hyperplanes. In this paper, we propose two cut-based mixed integer linear optimization (MILO) formulations for designing optimal binary classification trees (leaf vertices assign discrete classes). Our models leverage on-the-fly identification of minimal infeasible subsystems (MISs) from which we derive cutting planes that hold the form of packing constraints. We show theoretical improvements on the strongest flow-based MILO formulation currently in the literature and conduct experiments on publicly available datasets to show our models' ability to scale, strength against traditional branch and bound approaches, and robustness in out-of-sample test performance. Our code and data are available on GitHub.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Alston, B., & Hicks, I. V. (2024). Optimal Mixed Integer Linear Optimization Trained Multivariate Classification Trees. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2408.01297
MLA 9
Alston, Brandon, and Illya V. Hicks. “Optimal Mixed Integer Linear Optimization Trained Multivariate Classification Trees.” arXiv (Cornell University), 2024. https://doi.org/10.48550/arxiv.2408.01297.
Chicago
Alston, Brandon and Illya V. Hicks. 2024. “Optimal Mixed Integer Linear Optimization Trained Multivariate Classification Trees.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.2408.01297.
Harvard
Alston, B. and Hicks, I. V. (2024) ‘Optimal Mixed Integer Linear Optimization Trained Multivariate Classification Trees’, arXiv (Cornell University). doi:10.48550/arxiv.2408.01297.
IEEE
B. Alston and I. V. Hicks, “Optimal Mixed Integer Linear Optimization Trained Multivariate Classification Trees,” arXiv (Cornell University), 2024, doi: 10.48550/arxiv.2408.01297.
BibTeX
@misc{alston2024optimal,
title = {{Optimal Mixed Integer Linear Optimization Trained Multivariate Classification Trees}},
author = {Alston, Brandon and Hicks, Illya V.},
howpublished = {arXiv (Cornell University)},
year = {2024},
doi = {10.48550/arxiv.2408.01297},
url = {https://doi.org/10.48550/arxiv.2408.01297}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Physical Sciences › Mathematics › Numerical Analysis › Advanced Optimization Algorithms Research
- multivariate decision trees
- mixed-integer linear programming
- cutting planes
- packing constraints
- flow-based formulation
- bi-objective optimization
- branch and bound
Work with this paper
Most-cited papers in Mathematics
- Random ForestsLeo Breiman · Machine Learning · 2001 · 142,830 citations
- Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple TestingYoav Benjamini, Yosef Hochberg · Journal of the Royal Statistical Society Series B (Statistical Methodology) · 1995 · 113,923 citations
- Fitting Linear Mixed-Effects Models Using lme4Douglas M. Bates, Martin Maechler, Benjamin M. Bolker and 1 more · Journal of Statistical Software · 2015 · 100,328 citations
- The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations.Reuben M. Baron, David A. Kenny · Journal of Personality and Social Psychology · 1986 · 95,866 citations
- Using multivariate statisticsBarbara Gerson Tabachnick, Linda S. Fidell · 1983 · 79,867 citations
Questions about this paper
How do I cite this paper in APA style?
Alston, B., & Hicks, I. V. (2024). Optimal Mixed Integer Linear Optimization Trained Multivariate Classification Trees. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2408.01297
How many times has this paper been cited?
0 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.
Who wrote this paper?
Brandon Alston, Illya V. Hicks.
What is the DOI of this paper?
10.48550/arxiv.2408.01297, permanently at https://doi.org/10.48550/arxiv.2408.01297. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.