Mixed-Curvature Decision Trees and Random Forests

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Chlenski, Philippe, Chu, Quentin, Pe'er, Itsik
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912362933518336
author Chlenski, Philippe
Chu, Quentin
Pe'er, Itsik
author_facet Chlenski, Philippe
Chu, Quentin
Pe'er, Itsik
contents We extend decision tree and random forest algorithms to product space manifolds: Cartesian products of Euclidean, hyperspherical, and hyperbolic manifolds. Such spaces have extremely expressive geometries capable of representing many arrangements of distances with low metric distortion. To date, all classifiers for product spaces fit a single linear decision boundary, and no regressor has been described. Our method enables a simple, expressive method for classification and regression in product manifolds. We demonstrate the superior accuracy of our tool compared to Euclidean methods operating in the ambient space or the tangent plane of the manifold across a range of constant-curvature and product manifolds. Code for our implementation and experiments is available at https://github.com/pchlenski/embedders.
format Preprint
id arxiv_https___arxiv_org_abs_2406_05227
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Mixed-Curvature Decision Trees and Random Forests
Chlenski, Philippe
Chu, Quentin
Pe'er, Itsik
Machine Learning
We extend decision tree and random forest algorithms to product space manifolds: Cartesian products of Euclidean, hyperspherical, and hyperbolic manifolds. Such spaces have extremely expressive geometries capable of representing many arrangements of distances with low metric distortion. To date, all classifiers for product spaces fit a single linear decision boundary, and no regressor has been described. Our method enables a simple, expressive method for classification and regression in product manifolds. We demonstrate the superior accuracy of our tool compared to Euclidean methods operating in the ambient space or the tangent plane of the manifold across a range of constant-curvature and product manifolds. Code for our implementation and experiments is available at https://github.com/pchlenski/embedders.
title Mixed-Curvature Decision Trees and Random Forests
topic Machine Learning
url https://arxiv.org/abs/2406.05227