Detecting practically significant dependencies in metric spaces via distance correlations
Fuente:
arXiv
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866918207399395328 |
|---|---|
| author | Dette, Holger Kroll, Marius |
| author_facet | Dette, Holger Kroll, Marius |
| contents | We take a different look at the problem of testing the independence of two metric-space-valued random variables using the distance correlation. Instead of testing if the distance correlation vanishes exactly, we are interested in the hypothesis that it does not exceed a certain threshold. Our testing problem is motivated by the observation that in many cases it is more reasonable to test for a practically significant dependency since it is rare that a hypothesis of perfect independence is exactly satisfied. This point of view also reflects statistical practice, where one often classifies the strength of the association in categories such as `small', `medium' and `large' and the precise definitions depend on the specific application. To address these problems we develop a pivotal test for the hypothesis that the distance correlation between two random variables does not exceed a pre-specified threshold $Δ$. We also determine a minimum value $\hat Δ_α$ from the data such that the hypothesis is rejected for all $Δ\leq \hat Δ_α$ at controlled type I error $α$. This quantity can be interpreted as a measure of evidence against the hypothesis that the distance correlation is less or equal than $Δ$. The new test is applicable to processes taking values in separable metric spaces of strong negative type, covering Euclidean as well as functional data. We do not assume independent observations, and instead prove our results for absolutely regular sample generating processes, which includes many time series such as ARMA and GARCH models. Our approach is based on a new functional limit theorem for the sequential distance correlation process, and can also be used to construct confidence intervals for the distance correlation without the need for resampling. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_16177 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Detecting practically significant dependencies in metric spaces via distance correlations Dette, Holger Kroll, Marius Statistics Theory Probability 62G10, 62G15, 60F17 We take a different look at the problem of testing the independence of two metric-space-valued random variables using the distance correlation. Instead of testing if the distance correlation vanishes exactly, we are interested in the hypothesis that it does not exceed a certain threshold. Our testing problem is motivated by the observation that in many cases it is more reasonable to test for a practically significant dependency since it is rare that a hypothesis of perfect independence is exactly satisfied. This point of view also reflects statistical practice, where one often classifies the strength of the association in categories such as `small', `medium' and `large' and the precise definitions depend on the specific application. To address these problems we develop a pivotal test for the hypothesis that the distance correlation between two random variables does not exceed a pre-specified threshold $Δ$. We also determine a minimum value $\hat Δ_α$ from the data such that the hypothesis is rejected for all $Δ\leq \hat Δ_α$ at controlled type I error $α$. This quantity can be interpreted as a measure of evidence against the hypothesis that the distance correlation is less or equal than $Δ$. The new test is applicable to processes taking values in separable metric spaces of strong negative type, covering Euclidean as well as functional data. We do not assume independent observations, and instead prove our results for absolutely regular sample generating processes, which includes many time series such as ARMA and GARCH models. Our approach is based on a new functional limit theorem for the sequential distance correlation process, and can also be used to construct confidence intervals for the distance correlation without the need for resampling. |
| title | Detecting practically significant dependencies in metric spaces via distance correlations |
| topic | Statistics Theory Probability 62G10, 62G15, 60F17 |
| url | https://arxiv.org/abs/2411.16177 |