Kernel KMeans clustering splits for end-to-end unsupervised decision trees
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866914685137190912 |
|---|---|
| author | Ohl, Louis Mattei, Pierre-Alexandre Leclercq, Mickaël Droit, Arnaud Precioso, Frédéric |
| author_facet | Ohl, Louis Mattei, Pierre-Alexandre Leclercq, Mickaël Droit, Arnaud Precioso, Frédéric |
| contents | Trees are convenient models for obtaining explainable predictions on relatively small datasets. Although there are many proposals for the end-to-end construction of such trees in supervised learning, learning a tree end-to-end for clustering without labels remains an open challenge. As most works focus on interpreting with trees the result of another clustering algorithm, we present here a novel end-to-end trained unsupervised binary tree for clustering: Kauri. This method performs a greedy maximisation of the kernel KMeans objective without requiring the definition of centroids. We compare this model on multiple datasets with recent unsupervised trees and show that Kauri performs identically when using a linear kernel. For other kernels, Kauri often outperforms the concatenation of kernel KMeans and a CART decision tree. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_12232 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Kernel KMeans clustering splits for end-to-end unsupervised decision trees Ohl, Louis Mattei, Pierre-Alexandre Leclercq, Mickaël Droit, Arnaud Precioso, Frédéric Machine Learning Artificial Intelligence 62h30 G.3 Trees are convenient models for obtaining explainable predictions on relatively small datasets. Although there are many proposals for the end-to-end construction of such trees in supervised learning, learning a tree end-to-end for clustering without labels remains an open challenge. As most works focus on interpreting with trees the result of another clustering algorithm, we present here a novel end-to-end trained unsupervised binary tree for clustering: Kauri. This method performs a greedy maximisation of the kernel KMeans objective without requiring the definition of centroids. We compare this model on multiple datasets with recent unsupervised trees and show that Kauri performs identically when using a linear kernel. For other kernels, Kauri often outperforms the concatenation of kernel KMeans and a CART decision tree. |
| title | Kernel KMeans clustering splits for end-to-end unsupervised decision trees |
| topic | Machine Learning Artificial Intelligence 62h30 G.3 |
| url | https://arxiv.org/abs/2402.12232 |