Deep Nonnegative Matrix Factorization with Beta Divergences

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Leplat, Valentin, Hien, Le Thi Khanh, Onwunta, Akwum, Gillis, Nicolas
Natura: Preprint
Pubblicazione: 2023
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913641700261888
author Leplat, Valentin
Hien, Le Thi Khanh
Onwunta, Akwum
Gillis, Nicolas
author_facet Leplat, Valentin
Hien, Le Thi Khanh
Onwunta, Akwum
Gillis, Nicolas
contents Deep Nonnegative Matrix Factorization (deep NMF) has recently emerged as a valuable technique for extracting multiple layers of features across different scales. However, all existing deep NMF models and algorithms have primarily centered their evaluation on the least squares error, which may not be the most appropriate metric for assessing the quality of approximations on diverse datasets. For instance, when dealing with data types such as audio signals and documents, it is widely acknowledged that $β$-divergences offer a more suitable alternative. In this paper, we develop new models and algorithms for deep NMF using some $β$-divergences, with a focus on the Kullback-Leibler divergence. Subsequently, we apply these techniques to the extraction of facial features, the identification of topics within document collections, and the identification of materials within hyperspectral images.
format Preprint
id arxiv_https___arxiv_org_abs_2309_08249
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Deep Nonnegative Matrix Factorization with Beta Divergences
Leplat, Valentin
Hien, Le Thi Khanh
Onwunta, Akwum
Gillis, Nicolas
Machine Learning
Numerical Analysis
Signal Processing
Deep Nonnegative Matrix Factorization (deep NMF) has recently emerged as a valuable technique for extracting multiple layers of features across different scales. However, all existing deep NMF models and algorithms have primarily centered their evaluation on the least squares error, which may not be the most appropriate metric for assessing the quality of approximations on diverse datasets. For instance, when dealing with data types such as audio signals and documents, it is widely acknowledged that $β$-divergences offer a more suitable alternative. In this paper, we develop new models and algorithms for deep NMF using some $β$-divergences, with a focus on the Kullback-Leibler divergence. Subsequently, we apply these techniques to the extraction of facial features, the identification of topics within document collections, and the identification of materials within hyperspectral images.
title Deep Nonnegative Matrix Factorization with Beta Divergences
topic Machine Learning
Numerical Analysis
Signal Processing
url https://arxiv.org/abs/2309.08249