Saved in:
Bibliographic Details
Main Authors: Han, Xiao, Yang, Qing, Fan, Yingying
Format: Preprint
Published: 2019
Subjects:
Online Access:https://arxiv.org/abs/1912.11583
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910690379300864
author Han, Xiao
Yang, Qing
Fan, Yingying
author_facet Han, Xiao
Yang, Qing
Fan, Yingying
contents Determining the precise rank is an important problem in many large-scale applications with matrix data exploiting low-rank plus noise models. In this paper, we suggest a universal approach to rank inference via residual subsampling (RIRS) for testing and estimating rank in a wide family of models, including many popularly used network models such as the degree corrected mixed membership model as a special case. Our procedure constructs a test statistic via subsampling entries of the residual matrix after extracting the spiked components. The test statistic converges in distribution to the standard normal under the null hypothesis, and diverges to infinity with asymptotic probability one under the alternative hypothesis. The effectiveness of RIRS procedure is justified theoretically, utilizing the asymptotic expansions of eigenvectors and eigenvalues for large random matrices recently developed in [11] and [12]. The advantages of the newly suggested procedure are demonstrated through several simulation and real data examples.
format Preprint
id arxiv_https___arxiv_org_abs_1912_11583
institution arXiv
publishDate 2019
record_format arxiv
spellingShingle Universal Rank Inference via Residual Subsampling with Application to Large Networks
Han, Xiao
Yang, Qing
Fan, Yingying
Statistics Theory
Determining the precise rank is an important problem in many large-scale applications with matrix data exploiting low-rank plus noise models. In this paper, we suggest a universal approach to rank inference via residual subsampling (RIRS) for testing and estimating rank in a wide family of models, including many popularly used network models such as the degree corrected mixed membership model as a special case. Our procedure constructs a test statistic via subsampling entries of the residual matrix after extracting the spiked components. The test statistic converges in distribution to the standard normal under the null hypothesis, and diverges to infinity with asymptotic probability one under the alternative hypothesis. The effectiveness of RIRS procedure is justified theoretically, utilizing the asymptotic expansions of eigenvectors and eigenvalues for large random matrices recently developed in [11] and [12]. The advantages of the newly suggested procedure are demonstrated through several simulation and real data examples.
title Universal Rank Inference via Residual Subsampling with Application to Large Networks
topic Statistics Theory
url https://arxiv.org/abs/1912.11583