Robust Blockwise Random Pivoting: Fast and Accurate Adaptive Interpolative Decomposition

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Dong, Yijun, Chen, Chao, Martinsson, Per-Gunnar, Pearce, Katherine
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915071790153728
author Dong, Yijun
Chen, Chao
Martinsson, Per-Gunnar
Pearce, Katherine
author_facet Dong, Yijun
Chen, Chao
Martinsson, Per-Gunnar
Pearce, Katherine
contents The interpolative decomposition (ID) aims to construct a low-rank approximation formed by a basis consisting of row/column skeletons in the original matrix and a corresponding interpolation matrix. This work explores fast and accurate ID algorithms from comprehensive perspectives for empirical performance, including accuracy in both skeleton selection and interpolation matrix construction, efficiency in terms of asymptotic complexity and hardware efficiency, as well as rank adaptiveness. While many algorithms have been developed to optimize some of these aspects, practical ID algorithms proficient in all aspects remain absent. To fill in the gap, we introduce robust blockwise random pivoting (RBRP) that is asymptotically fast, hardware-efficient, and rank-adaptive, providing accurate skeletons and interpolation matrices comparable to the best existing ID algorithms in practice. Through extensive numerical experiments on various synthetic and natural datasets, we demonstrate the appealing empirical performance of RBRP from the aforementioned perspectives, as well as the robustness of RBRP to adversarial inputs.
format Preprint
id arxiv_https___arxiv_org_abs_2309_16002
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Robust Blockwise Random Pivoting: Fast and Accurate Adaptive Interpolative Decomposition
Dong, Yijun
Chen, Chao
Martinsson, Per-Gunnar
Pearce, Katherine
Numerical Analysis
65F55, 65Y05, 68T05
The interpolative decomposition (ID) aims to construct a low-rank approximation formed by a basis consisting of row/column skeletons in the original matrix and a corresponding interpolation matrix. This work explores fast and accurate ID algorithms from comprehensive perspectives for empirical performance, including accuracy in both skeleton selection and interpolation matrix construction, efficiency in terms of asymptotic complexity and hardware efficiency, as well as rank adaptiveness. While many algorithms have been developed to optimize some of these aspects, practical ID algorithms proficient in all aspects remain absent. To fill in the gap, we introduce robust blockwise random pivoting (RBRP) that is asymptotically fast, hardware-efficient, and rank-adaptive, providing accurate skeletons and interpolation matrices comparable to the best existing ID algorithms in practice. Through extensive numerical experiments on various synthetic and natural datasets, we demonstrate the appealing empirical performance of RBRP from the aforementioned perspectives, as well as the robustness of RBRP to adversarial inputs.
title Robust Blockwise Random Pivoting: Fast and Accurate Adaptive Interpolative Decomposition
topic Numerical Analysis
65F55, 65Y05, 68T05
url https://arxiv.org/abs/2309.16002