Data Skeleton Learning: Scalable Active Clustering with Sparse Graph Structures
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866908530435424256 |
|---|---|
| author | Xie, Wen-Bo Fu, Xun Chen, Bin Lee, Yan-Li Deng, Tao Zou, Tian Wang, Xin Liu, Zhen Srivastavad, Jaideep |
| author_facet | Xie, Wen-Bo Fu, Xun Chen, Bin Lee, Yan-Li Deng, Tao Zou, Tian Wang, Xin Liu, Zhen Srivastavad, Jaideep |
| contents | In this work, we focus on the efficiency and scalability of pairwise constraint-based active clustering, crucial for processing large-scale data in applications such as data mining, knowledge annotation, and AI model pre-training. Our goals are threefold: (1) to reduce computational costs for iterative clustering updates; (2) to enhance the impact of user-provided constraints to minimize annotation requirements for precise clustering; and (3) to cut down memory usage in practical deployments. To achieve these aims, we propose a graph-based active clustering algorithm that utilizes two sparse graphs: one for representing relationships between data (our proposed data skeleton) and another for updating this data skeleton. These two graphs work in concert, enabling the refinement of connected subgraphs within the data skeleton to create nested clusters. Our empirical analysis confirms that the proposed algorithm consistently facilitates more accurate clustering with dramatically less input of user-provided constraints, and outperforms its counterparts in terms of computational performance and scalability, while maintaining robustness across various distance metrics. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_08530 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Data Skeleton Learning: Scalable Active Clustering with Sparse Graph Structures Xie, Wen-Bo Fu, Xun Chen, Bin Lee, Yan-Li Deng, Tao Zou, Tian Wang, Xin Liu, Zhen Srivastavad, Jaideep Machine Learning In this work, we focus on the efficiency and scalability of pairwise constraint-based active clustering, crucial for processing large-scale data in applications such as data mining, knowledge annotation, and AI model pre-training. Our goals are threefold: (1) to reduce computational costs for iterative clustering updates; (2) to enhance the impact of user-provided constraints to minimize annotation requirements for precise clustering; and (3) to cut down memory usage in practical deployments. To achieve these aims, we propose a graph-based active clustering algorithm that utilizes two sparse graphs: one for representing relationships between data (our proposed data skeleton) and another for updating this data skeleton. These two graphs work in concert, enabling the refinement of connected subgraphs within the data skeleton to create nested clusters. Our empirical analysis confirms that the proposed algorithm consistently facilitates more accurate clustering with dramatically less input of user-provided constraints, and outperforms its counterparts in terms of computational performance and scalability, while maintaining robustness across various distance metrics. |
| title | Data Skeleton Learning: Scalable Active Clustering with Sparse Graph Structures |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2509.08530 |