A review of NMF, PLSA, LBA, EMA, and LCA with a focus on the identifiability issue

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Qi, Qianqian, van der Heijden, Peter G. M.
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866908734053154816
author Qi, Qianqian
van der Heijden, Peter G. M.
author_facet Qi, Qianqian
van der Heijden, Peter G. M.
contents Across fields such as machine learning, social science, geography, considerable attention has been given to models that factorize a nonnegative matrix into the product of two or three matrices, subject to nonnegative or row-sum-to-1 constraints. Although these models are to a large extend similar or even equivalent, they are presented under different names, and their similarity is not well known. This paper highlights similarities among five popular models, latent budget analysis (LBA), latent class analysis (LCA), end-member analysis (EMA), probabilistic latent semantic analysis (PLSA), and nonnegative matrix factorization (NMF). We focus on an essential issue-identifiability-of these models and prove that the solution of LBA, EMA, LCA, PLSA is unique if and only if the solution of NMF is unique. We also provide a brief review for algorithms of these models. We illustrate the models with a time budget dataset from social science, and end the paper with a discussion of closely related models such as archetypal analysis.
format Preprint
id arxiv_https___arxiv_org_abs_2512_22282
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A review of NMF, PLSA, LBA, EMA, and LCA with a focus on the identifiability issue
Qi, Qianqian
van der Heijden, Peter G. M.
Machine Learning
Optimization and Control
Statistics Theory
Across fields such as machine learning, social science, geography, considerable attention has been given to models that factorize a nonnegative matrix into the product of two or three matrices, subject to nonnegative or row-sum-to-1 constraints. Although these models are to a large extend similar or even equivalent, they are presented under different names, and their similarity is not well known. This paper highlights similarities among five popular models, latent budget analysis (LBA), latent class analysis (LCA), end-member analysis (EMA), probabilistic latent semantic analysis (PLSA), and nonnegative matrix factorization (NMF). We focus on an essential issue-identifiability-of these models and prove that the solution of LBA, EMA, LCA, PLSA is unique if and only if the solution of NMF is unique. We also provide a brief review for algorithms of these models. We illustrate the models with a time budget dataset from social science, and end the paper with a discussion of closely related models such as archetypal analysis.
title A review of NMF, PLSA, LBA, EMA, and LCA with a focus on the identifiability issue
topic Machine Learning
Optimization and Control
Statistics Theory
url https://arxiv.org/abs/2512.22282