A Hybrid Mixture of $t$-Factor Analyzers for Clustering High-dimensional Data

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Kareem, Kazeem, Dai, Fan
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913974904160256
author Kareem, Kazeem
Dai, Fan
author_facet Kareem, Kazeem
Dai, Fan
contents This paper develops a novel hybrid approach for estimating the mixture model of $t$-factor analyzers (MtFA) that employs multivariate $t$-distribution and factor model to cluster and characterize grouped data. The traditional estimation method for MtFA faces computational challenges, particularly in high-dimensional settings, where the eigendecomposition of large covariance matrices and the iterative nature of Expectation-Maximization (EM) algorithms lead to scalability issues. We propose a computational scheme that integrates a profile likelihood method into the EM framework to efficiently obtain the model parameter estimates. The effectiveness of our approach is demonstrated through simulations showcasing its superior computational efficiency compared to the existing method, while preserving clustering accuracy and resilience against outliers. Our method is applied to cluster the Gamma-ray bursts, reinforcing several claims in the literature that Gamma-ray bursts have heterogeneous subpopulations and providing characterizations of the estimated groups.
format Preprint
id arxiv_https___arxiv_org_abs_2504_21120
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Hybrid Mixture of $t$-Factor Analyzers for Clustering High-dimensional Data
Kareem, Kazeem
Dai, Fan
Methodology
High Energy Astrophysical Phenomena
Applications
Computation
Machine Learning
62H05, 62H12, 62H20, 62H25, 62H30, 62P35
G.3; I.2; I.5; I.6; J.2
This paper develops a novel hybrid approach for estimating the mixture model of $t$-factor analyzers (MtFA) that employs multivariate $t$-distribution and factor model to cluster and characterize grouped data. The traditional estimation method for MtFA faces computational challenges, particularly in high-dimensional settings, where the eigendecomposition of large covariance matrices and the iterative nature of Expectation-Maximization (EM) algorithms lead to scalability issues. We propose a computational scheme that integrates a profile likelihood method into the EM framework to efficiently obtain the model parameter estimates. The effectiveness of our approach is demonstrated through simulations showcasing its superior computational efficiency compared to the existing method, while preserving clustering accuracy and resilience against outliers. Our method is applied to cluster the Gamma-ray bursts, reinforcing several claims in the literature that Gamma-ray bursts have heterogeneous subpopulations and providing characterizations of the estimated groups.
title A Hybrid Mixture of $t$-Factor Analyzers for Clustering High-dimensional Data
topic Methodology
High Energy Astrophysical Phenomena
Applications
Computation
Machine Learning
62H05, 62H12, 62H20, 62H25, 62H30, 62P35
G.3; I.2; I.5; I.6; J.2
url https://arxiv.org/abs/2504.21120