Multiple Testing of Linear Forms for Noisy Matrix Completion
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866929751932796928 |
|---|---|
| author | Ma, Wanteng Du, Lilun Xia, Dong Yuan, Ming |
| author_facet | Ma, Wanteng Du, Lilun Xia, Dong Yuan, Ming |
| contents | Many important tasks of large-scale recommender systems can be naturally cast as testing multiple linear forms for noisy matrix completion. These problems, however, present unique challenges because of the subtle bias-and-variance tradeoff of and an intricate dependence among the estimated entries induced by the low-rank structure. In this paper, we develop a general approach to overcome these difficulties by introducing new statistics for individual tests with sharp asymptotics both marginally and jointly, and utilizing them to control the false discovery rate (FDR) via a data splitting and symmetric aggregation scheme. We show that valid FDR control can be achieved with guaranteed power under nearly optimal sample size requirements using the proposed methodology. Extensive numerical simulations and real data examples are also presented to further illustrate its practical merits. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2312_00305 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Multiple Testing of Linear Forms for Noisy Matrix Completion Ma, Wanteng Du, Lilun Xia, Dong Yuan, Ming Methodology Machine Learning Statistics Theory Many important tasks of large-scale recommender systems can be naturally cast as testing multiple linear forms for noisy matrix completion. These problems, however, present unique challenges because of the subtle bias-and-variance tradeoff of and an intricate dependence among the estimated entries induced by the low-rank structure. In this paper, we develop a general approach to overcome these difficulties by introducing new statistics for individual tests with sharp asymptotics both marginally and jointly, and utilizing them to control the false discovery rate (FDR) via a data splitting and symmetric aggregation scheme. We show that valid FDR control can be achieved with guaranteed power under nearly optimal sample size requirements using the proposed methodology. Extensive numerical simulations and real data examples are also presented to further illustrate its practical merits. |
| title | Multiple Testing of Linear Forms for Noisy Matrix Completion |
| topic | Methodology Machine Learning Statistics Theory |
| url | https://arxiv.org/abs/2312.00305 |