RGNMR: A Gauss-Newton method for robust matrix completion with theoretical guarantees

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Laufer, Eilon Vaknin, Nadler, Boaz
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911317376368640
author Laufer, Eilon Vaknin
Nadler, Boaz
author_facet Laufer, Eilon Vaknin
Nadler, Boaz
contents Recovering a low rank matrix from a subset of its entries, some of which may be corrupted, is known as the robust matrix completion (RMC) problem. Existing RMC methods have several limitations: they require a relatively large number of observed entries; they may fail under overparametrization, when their assumed rank is higher than the correct one; and many of them fail to recover even mildly ill-conditioned matrices. In this paper we propose a novel RMC method, denoted $\texttt{RGNMR}$, which overcomes these limitations. $\texttt{RGNMR}$ is a simple factorization-based iterative algorithm, which combines a Gauss-Newton linearization with removal of entries suspected to be outliers. On the theoretical front, we prove that under suitable assumptions, $\texttt{RGNMR}$ is guaranteed exact recovery of the underlying low rank matrix. Our theoretical results improve upon the best currently known for factorization-based methods. On the empirical front, we show via several simulations the advantages of $\texttt{RGNMR}$ over existing RMC methods, and in particular its ability to handle a small number of observed entries, overparameterization of the rank and ill-conditioned matrices.
format Preprint
id arxiv_https___arxiv_org_abs_2505_12919
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle RGNMR: A Gauss-Newton method for robust matrix completion with theoretical guarantees
Laufer, Eilon Vaknin
Nadler, Boaz
Machine Learning
Numerical Analysis
Optimization and Control
Recovering a low rank matrix from a subset of its entries, some of which may be corrupted, is known as the robust matrix completion (RMC) problem. Existing RMC methods have several limitations: they require a relatively large number of observed entries; they may fail under overparametrization, when their assumed rank is higher than the correct one; and many of them fail to recover even mildly ill-conditioned matrices. In this paper we propose a novel RMC method, denoted $\texttt{RGNMR}$, which overcomes these limitations. $\texttt{RGNMR}$ is a simple factorization-based iterative algorithm, which combines a Gauss-Newton linearization with removal of entries suspected to be outliers. On the theoretical front, we prove that under suitable assumptions, $\texttt{RGNMR}$ is guaranteed exact recovery of the underlying low rank matrix. Our theoretical results improve upon the best currently known for factorization-based methods. On the empirical front, we show via several simulations the advantages of $\texttt{RGNMR}$ over existing RMC methods, and in particular its ability to handle a small number of observed entries, overparameterization of the rank and ill-conditioned matrices.
title RGNMR: A Gauss-Newton method for robust matrix completion with theoretical guarantees
topic Machine Learning
Numerical Analysis
Optimization and Control
url https://arxiv.org/abs/2505.12919