Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2404.16505 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909181661937664 |
|---|---|
| author | Perraudin, Nathanaël Teutrie, Adrien Hébert, Cécile Obozinski, Guillaume |
| author_facet | Perraudin, Nathanaël Teutrie, Adrien Hébert, Cécile Obozinski, Guillaume |
| contents | We consider the problem of regularized Poisson Non-negative Matrix Factorization (NMF) problem, encompassing various regularization terms such as Lipschitz and relatively smooth functions, alongside linear constraints. This problem holds significant relevance in numerous Machine Learning applications, particularly within the domain of physical linear unmixing problems. A notable challenge arises from the main loss term in the Poisson NMF problem being a KL divergence, which is non-Lipschitz, rendering traditional gradient descent-based approaches inefficient. In this contribution, we explore the utilization of Block Successive Upper Minimization (BSUM) to overcome this challenge. We build approriate majorizing function for Lipschitz and relatively smooth functions, and show how to introduce linear constraints into the problem. This results in the development of two novel algorithms for regularized Poisson NMF. We conduct numerical simulations to showcase the effectiveness of our approach. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_16505 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Efficient algorithms for regularized Poisson Non-negative Matrix Factorization Perraudin, Nathanaël Teutrie, Adrien Hébert, Cécile Obozinski, Guillaume Machine Learning Optimization and Control We consider the problem of regularized Poisson Non-negative Matrix Factorization (NMF) problem, encompassing various regularization terms such as Lipschitz and relatively smooth functions, alongside linear constraints. This problem holds significant relevance in numerous Machine Learning applications, particularly within the domain of physical linear unmixing problems. A notable challenge arises from the main loss term in the Poisson NMF problem being a KL divergence, which is non-Lipschitz, rendering traditional gradient descent-based approaches inefficient. In this contribution, we explore the utilization of Block Successive Upper Minimization (BSUM) to overcome this challenge. We build approriate majorizing function for Lipschitz and relatively smooth functions, and show how to introduce linear constraints into the problem. This results in the development of two novel algorithms for regularized Poisson NMF. We conduct numerical simulations to showcase the effectiveness of our approach. |
| title | Efficient algorithms for regularized Poisson Non-negative Matrix Factorization |
| topic | Machine Learning Optimization and Control |
| url | https://arxiv.org/abs/2404.16505 |