CART-ELC: Oblique Decision Tree Induction via Exhaustive Search
Fuente:
arXiv
Saved in:
| Main Author: | |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910933427683328 |
|---|---|
| author | Laack, Andrew D. |
| author_facet | Laack, Andrew D. |
| contents | Oblique decision trees have attracted attention due to their potential for improved classification performance over traditional axis-aligned decision trees. However, methods that rely on exhaustive search to find oblique splits face computational challenges. As a result, they have not been widely explored. We introduce a novel algorithm, Classification and Regression Tree - Exhaustive Linear Combinations (CART-ELC), for inducing oblique decision trees that performs an exhaustive search on a restricted set of hyperplanes. We then investigate the algorithm's computational complexity and its predictive capabilities. Our results demonstrate that CART-ELC consistently achieves competitive performance on small datasets, often yielding statistically significant improvements in classification accuracy relative to existing decision tree induction algorithms, while frequently producing shallower, simpler, and thus more interpretable trees. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_05402 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | CART-ELC: Oblique Decision Tree Induction via Exhaustive Search Laack, Andrew D. Machine Learning Artificial Intelligence Data Structures and Algorithms I.2.6; I.5.2; F.2.2; G.3; G.2.1 Oblique decision trees have attracted attention due to their potential for improved classification performance over traditional axis-aligned decision trees. However, methods that rely on exhaustive search to find oblique splits face computational challenges. As a result, they have not been widely explored. We introduce a novel algorithm, Classification and Regression Tree - Exhaustive Linear Combinations (CART-ELC), for inducing oblique decision trees that performs an exhaustive search on a restricted set of hyperplanes. We then investigate the algorithm's computational complexity and its predictive capabilities. Our results demonstrate that CART-ELC consistently achieves competitive performance on small datasets, often yielding statistically significant improvements in classification accuracy relative to existing decision tree induction algorithms, while frequently producing shallower, simpler, and thus more interpretable trees. |
| title | CART-ELC: Oblique Decision Tree Induction via Exhaustive Search |
| topic | Machine Learning Artificial Intelligence Data Structures and Algorithms I.2.6; I.5.2; F.2.2; G.3; G.2.1 |
| url | https://arxiv.org/abs/2505.05402 |