Permutation-Based Rank Test in the Presence of Discretization and Application in Causal Discovery with Mixed Data
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913889827946496 |
|---|---|
| author | Dong, Xinshuai Ng, Ignavier Sun, Boyang Dai, Haoyue Hao, Guang-Yuan Fan, Shunxing Spirtes, Peter Qiu, Yumou Zhang, Kun |
| author_facet | Dong, Xinshuai Ng, Ignavier Sun, Boyang Dai, Haoyue Hao, Guang-Yuan Fan, Shunxing Spirtes, Peter Qiu, Yumou Zhang, Kun |
| contents | Recent advances have shown that statistical tests for the rank of cross-covariance matrices play an important role in causal discovery. These rank tests include partial correlation tests as special cases and provide further graphical information about latent variables. Existing rank tests typically assume that all the continuous variables can be perfectly measured, and yet, in practice many variables can only be measured after discretization. For example, in psychometric studies, the continuous level of certain personality dimensions of a person can only be measured after being discretized into order-preserving options such as disagree, neutral, and agree. Motivated by this, we propose Mixed data Permutation-based Rank Test (MPRT), which properly controls the statistical errors even when some or all variables are discretized. Theoretically, we establish the exchangeability and estimate the asymptotic null distribution by permutations; as a consequence, MPRT can effectively control the Type I error in the presence of discretization while previous methods cannot. Empirically, our method is validated by extensive experiments on synthetic data and real-world data to demonstrate its effectiveness as well as applicability in causal discovery. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_18990 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Permutation-Based Rank Test in the Presence of Discretization and Application in Causal Discovery with Mixed Data Dong, Xinshuai Ng, Ignavier Sun, Boyang Dai, Haoyue Hao, Guang-Yuan Fan, Shunxing Spirtes, Peter Qiu, Yumou Zhang, Kun Machine Learning Recent advances have shown that statistical tests for the rank of cross-covariance matrices play an important role in causal discovery. These rank tests include partial correlation tests as special cases and provide further graphical information about latent variables. Existing rank tests typically assume that all the continuous variables can be perfectly measured, and yet, in practice many variables can only be measured after discretization. For example, in psychometric studies, the continuous level of certain personality dimensions of a person can only be measured after being discretized into order-preserving options such as disagree, neutral, and agree. Motivated by this, we propose Mixed data Permutation-based Rank Test (MPRT), which properly controls the statistical errors even when some or all variables are discretized. Theoretically, we establish the exchangeability and estimate the asymptotic null distribution by permutations; as a consequence, MPRT can effectively control the Type I error in the presence of discretization while previous methods cannot. Empirically, our method is validated by extensive experiments on synthetic data and real-world data to demonstrate its effectiveness as well as applicability in causal discovery. |
| title | Permutation-Based Rank Test in the Presence of Discretization and Application in Causal Discovery with Mixed Data |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2501.18990 |