Accelerating k-Means Clustering with Cover Trees

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Lang, Andreas, Schubert, Erich
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912078476869632
author Lang, Andreas
Schubert, Erich
author_facet Lang, Andreas
Schubert, Erich
contents The k-means clustering algorithm is a popular algorithm that partitions data into k clusters. There are many improvements to accelerate the standard algorithm. Most current research employs upper and lower bounds on point-to-cluster distances and the triangle inequality to reduce the number of distance computations, with only arrays as underlying data structures. These approaches cannot exploit that nearby points are likely assigned to the same cluster. We propose a new k-means algorithm based on the cover tree index, that has relatively low overhead and performs well, for a wider parameter range, than previous approaches based on the k-d tree. By combining this with upper and lower bounds, as in state-of-the-art approaches, we obtain a hybrid algorithm that combines the benefits of tree aggregation and bounds-based filtering.
format Preprint
id arxiv_https___arxiv_org_abs_2410_15117
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Accelerating k-Means Clustering with Cover Trees
Lang, Andreas
Schubert, Erich
Machine Learning
The k-means clustering algorithm is a popular algorithm that partitions data into k clusters. There are many improvements to accelerate the standard algorithm. Most current research employs upper and lower bounds on point-to-cluster distances and the triangle inequality to reduce the number of distance computations, with only arrays as underlying data structures. These approaches cannot exploit that nearby points are likely assigned to the same cluster. We propose a new k-means algorithm based on the cover tree index, that has relatively low overhead and performs well, for a wider parameter range, than previous approaches based on the k-d tree. By combining this with upper and lower bounds, as in state-of-the-art approaches, we obtain a hybrid algorithm that combines the benefits of tree aggregation and bounds-based filtering.
title Accelerating k-Means Clustering with Cover Trees
topic Machine Learning
url https://arxiv.org/abs/2410.15117