Fast randomized numerical rank estimation for numerically low-rank matrices

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Meier, Maike, Nakatsukasa, Yuji
Natura: Preprint
Pubblicazione: 2021
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917558472409088
author Meier, Maike
Nakatsukasa, Yuji
author_facet Meier, Maike
Nakatsukasa, Yuji
contents Matrices with low-rank structure are ubiquitous in scientific computing. Choosing an appropriate rank is a key step in many computational algorithms that exploit low-rank structure. However, estimating the rank has been done largely in an ad-hoc fashion in large-scale settings. In this work we develop a randomized algorithm for estimating the numerical rank of a (numerically low-rank) matrix. The algorithm is based on sketching the matrix with random matrices from both left and right; the key fact is that with high probability, the sketches preserve the orders of magnitude of the leading singular values. We prove a result on the accuracy of the sketched singular values and show that gaps in the spectrum are detected. For an $m\times n$ $(m\geq n)$ matrix of numerical rank $r$, the algorithm runs with complexity $O(mn\log n+r^3)$, or less for structured matrices. The steps in the algorithm are required as a part of many low-rank algorithms, so the additional work required to estimate the rank can be even smaller in practice. Numerical experiments illustrate the speed and robustness of our rank estimator.
format Preprint
id arxiv_https___arxiv_org_abs_2105_07388
institution arXiv
publishDate 2021
record_format arxiv
spellingShingle Fast randomized numerical rank estimation for numerically low-rank matrices
Meier, Maike
Nakatsukasa, Yuji
Numerical Analysis
65F55 (primary) 65F99, 68W20, 60B20 (secondary)
Matrices with low-rank structure are ubiquitous in scientific computing. Choosing an appropriate rank is a key step in many computational algorithms that exploit low-rank structure. However, estimating the rank has been done largely in an ad-hoc fashion in large-scale settings. In this work we develop a randomized algorithm for estimating the numerical rank of a (numerically low-rank) matrix. The algorithm is based on sketching the matrix with random matrices from both left and right; the key fact is that with high probability, the sketches preserve the orders of magnitude of the leading singular values. We prove a result on the accuracy of the sketched singular values and show that gaps in the spectrum are detected. For an $m\times n$ $(m\geq n)$ matrix of numerical rank $r$, the algorithm runs with complexity $O(mn\log n+r^3)$, or less for structured matrices. The steps in the algorithm are required as a part of many low-rank algorithms, so the additional work required to estimate the rank can be even smaller in practice. Numerical experiments illustrate the speed and robustness of our rank estimator.
title Fast randomized numerical rank estimation for numerically low-rank matrices
topic Numerical Analysis
65F55 (primary) 65F99, 68W20, 60B20 (secondary)
url https://arxiv.org/abs/2105.07388