Classification EM-PCA for clustering and embedding

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Tighidet, Zineddine, Labiod, Lazhar, Nadif, Mohamed
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914168813125632
author Tighidet, Zineddine
Labiod, Lazhar
Nadif, Mohamed
author_facet Tighidet, Zineddine
Labiod, Lazhar
Nadif, Mohamed
contents The mixture model is undoubtedly one of the greatest contributions to clustering. For continuous data, Gaussian models are often used and the Expectation-Maximization (EM) algorithm is particularly suitable for estimating parameters from which clustering is inferred. If these models are particularly popular in various domains including image clustering, they however suffer from the dimensionality and also from the slowness of convergence of the EM algorithm. However, the Classification EM (CEM) algorithm, a classifying version, offers a fast convergence solution while dimensionality reduction still remains a challenge. Thus we propose in this paper an algorithm combining simultaneously and non-sequentially the two tasks --Data embedding and Clustering-- relying on Principal Component Analysis (PCA) and CEM. We demonstrate the interest of such approach in terms of clustering and data embedding. We also establish different connections with other clustering approaches.
format Preprint
id arxiv_https___arxiv_org_abs_2511_18992
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Classification EM-PCA for clustering and embedding
Tighidet, Zineddine
Labiod, Lazhar
Nadif, Mohamed
Machine Learning
Artificial Intelligence
Computation and Language
The mixture model is undoubtedly one of the greatest contributions to clustering. For continuous data, Gaussian models are often used and the Expectation-Maximization (EM) algorithm is particularly suitable for estimating parameters from which clustering is inferred. If these models are particularly popular in various domains including image clustering, they however suffer from the dimensionality and also from the slowness of convergence of the EM algorithm. However, the Classification EM (CEM) algorithm, a classifying version, offers a fast convergence solution while dimensionality reduction still remains a challenge. Thus we propose in this paper an algorithm combining simultaneously and non-sequentially the two tasks --Data embedding and Clustering-- relying on Principal Component Analysis (PCA) and CEM. We demonstrate the interest of such approach in terms of clustering and data embedding. We also establish different connections with other clustering approaches.
title Classification EM-PCA for clustering and embedding
topic Machine Learning
Artificial Intelligence
Computation and Language
url https://arxiv.org/abs/2511.18992