Incremental Seeded EM Algorithm for Clusterwise Linear Regression

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Kuang, Ye Chow, Ooi, Melanie
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909677265092608
author Kuang, Ye Chow
Ooi, Melanie
author_facet Kuang, Ye Chow
Ooi, Melanie
contents This paper proposes Incremental Seeded Expectation Maximization, an algorithm that improves upon the traditional Expectation Maximization computational flow for clusterwise or finite mixture linear regression tasks. The proposed method shows significantly better performance, particularly in scenarios involving high-dimensional input, noisy data, or a large number of clusters. Alongside the new algorithm, this paper introduces the concepts of $\textit{Resolvability}$ and $\textit{X-predictability}$, which enable more rigorous discussions of clusterwise regression problems. The resolvability index is quantified using parameters derived from the model, and results demonstrate its strong connection to model quality without requiring knowledge of the ground truth. This makes the $\textit{Resolvability}$ especially useful for assessing the quality of clusterwise regression models, and by extension, the conclusions drawn from them.
format Preprint
id arxiv_https___arxiv_org_abs_2507_04629
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Incremental Seeded EM Algorithm for Clusterwise Linear Regression
Kuang, Ye Chow
Ooi, Melanie
Computation
This paper proposes Incremental Seeded Expectation Maximization, an algorithm that improves upon the traditional Expectation Maximization computational flow for clusterwise or finite mixture linear regression tasks. The proposed method shows significantly better performance, particularly in scenarios involving high-dimensional input, noisy data, or a large number of clusters. Alongside the new algorithm, this paper introduces the concepts of $\textit{Resolvability}$ and $\textit{X-predictability}$, which enable more rigorous discussions of clusterwise regression problems. The resolvability index is quantified using parameters derived from the model, and results demonstrate its strong connection to model quality without requiring knowledge of the ground truth. This makes the $\textit{Resolvability}$ especially useful for assessing the quality of clusterwise regression models, and by extension, the conclusions drawn from them.
title Incremental Seeded EM Algorithm for Clusterwise Linear Regression
topic Computation
url https://arxiv.org/abs/2507.04629