Saved in:
Bibliographic Details
Main Authors: Guo, Youdong, Holy, Timothy E.
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2408.08260
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912180963639296
author Guo, Youdong
Holy, Timothy E.
author_facet Guo, Youdong
Holy, Timothy E.
contents Non-negative matrix factorization (NMF) is an important tool in signal processing and widely used to separate mixed sources into their components. Algorithms for NMF require that the user choose the number of components in advance, and if the results are unsatisfying one typically needs to start again with a different number of components. To make NMF more interactive and incremental, here we introduce GSVD-NMF, a method that proposes new components based on the generalized singular value decomposition (GSVD) to address discrepancies between the initial under-complete NMF results and the SVD of the original matrix. Simulation and experimental results demonstrate that GSVD-NMF often effectively recovers multiple missing components in under-complete NMF, with the recovered NMF solutions frequently reaching better local optima. The results further show that GSVD-NMF is compatible with various NMF algorithms and that directly augmenting components is more efficient than rerunning NMF from scratch with additional components. By deliberately starting from under-complete NMF, GSVD-NMF has the potential to be a recommended approach for a range of general NMF applications.
format Preprint
id arxiv_https___arxiv_org_abs_2408_08260
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle GSVD-NMF: Recovering Missing Features in Non-negative Matrix Factorization
Guo, Youdong
Holy, Timothy E.
Machine Learning
Signal Processing
Non-negative matrix factorization (NMF) is an important tool in signal processing and widely used to separate mixed sources into their components. Algorithms for NMF require that the user choose the number of components in advance, and if the results are unsatisfying one typically needs to start again with a different number of components. To make NMF more interactive and incremental, here we introduce GSVD-NMF, a method that proposes new components based on the generalized singular value decomposition (GSVD) to address discrepancies between the initial under-complete NMF results and the SVD of the original matrix. Simulation and experimental results demonstrate that GSVD-NMF often effectively recovers multiple missing components in under-complete NMF, with the recovered NMF solutions frequently reaching better local optima. The results further show that GSVD-NMF is compatible with various NMF algorithms and that directly augmenting components is more efficient than rerunning NMF from scratch with additional components. By deliberately starting from under-complete NMF, GSVD-NMF has the potential to be a recommended approach for a range of general NMF applications.
title GSVD-NMF: Recovering Missing Features in Non-negative Matrix Factorization
topic Machine Learning
Signal Processing
url https://arxiv.org/abs/2408.08260