High-Dimensional Independence Testing via Maximum and Average Distance Correlations
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , |
|---|---|
| Format: | Preprint |
| Publié: |
2020
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866912420929208320 |
|---|---|
| author | Shen, Cencheng Dong, Yuexiao |
| author_facet | Shen, Cencheng Dong, Yuexiao |
| contents | This paper investigates the utilization of maximum and average distance correlations for multivariate independence testing. We characterize their consistency properties in high-dimensional settings with respect to the number of marginally dependent dimensions, compare the advantages of each test statistic, examine their respective null distributions, and present a fast chi-square-based testing procedure. The resulting tests are non-parametric and applicable to both Euclidean distance and the Gaussian kernel as the underlying metric. To better understand the practical use cases of the proposed tests, we evaluate the empirical performance of the maximum distance correlation, average distance correlation, and the original distance correlation across various multivariate dependence scenarios, as well as conduct a real data experiment to test the presence of various cancer types and peptide levels in human plasma. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2001_01095 |
| institution | arXiv |
| publishDate | 2020 |
| record_format | arxiv |
| spellingShingle | High-Dimensional Independence Testing via Maximum and Average Distance Correlations Shen, Cencheng Dong, Yuexiao Machine Learning Methodology This paper investigates the utilization of maximum and average distance correlations for multivariate independence testing. We characterize their consistency properties in high-dimensional settings with respect to the number of marginally dependent dimensions, compare the advantages of each test statistic, examine their respective null distributions, and present a fast chi-square-based testing procedure. The resulting tests are non-parametric and applicable to both Euclidean distance and the Gaussian kernel as the underlying metric. To better understand the practical use cases of the proposed tests, we evaluate the empirical performance of the maximum distance correlation, average distance correlation, and the original distance correlation across various multivariate dependence scenarios, as well as conduct a real data experiment to test the presence of various cancer types and peptide levels in human plasma. |
| title | High-Dimensional Independence Testing via Maximum and Average Distance Correlations |
| topic | Machine Learning Methodology |
| url | https://arxiv.org/abs/2001.01095 |