A Sample Efficient Conditional Independence Test in the Presence of Discretization
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913887996084224 |
|---|---|
| author | Sun, Boyang Yao, Yu Dong, Xinshuai Liu, Zongfang Liu, Tongliang Qiu, Yumou Zhang, Kun |
| author_facet | Sun, Boyang Yao, Yu Dong, Xinshuai Liu, Zongfang Liu, Tongliang Qiu, Yumou Zhang, Kun |
| contents | In many real-world scenarios, interested variables are often represented as discretized values due to measurement limitations. Applying Conditional Independence (CI) tests directly to such discretized data, however, can lead to incorrect conclusions. To address this, recent advancements have sought to infer the correct CI relationship between the latent variables through binarizing observed data. However, this process inevitably results in a loss of information, which degrades the test's performance. Motivated by this, this paper introduces a sample-efficient CI test that does not rely on the binarization process. We find that the independence relationships of latent continuous variables can be established by addressing an over-identifying restriction problem with Generalized Method of Moments (GMM). Based on this insight, we derive an appropriate test statistic and establish its asymptotic distribution correctly reflecting CI by leveraging nodewise regression. Theoretical findings and Empirical results across various datasets demonstrate that the superiority and effectiveness of our proposed test. Our code implementation is provided in https://github.com/boyangaaaaa/DCT |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_08747 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | A Sample Efficient Conditional Independence Test in the Presence of Discretization Sun, Boyang Yao, Yu Dong, Xinshuai Liu, Zongfang Liu, Tongliang Qiu, Yumou Zhang, Kun Artificial Intelligence Machine Learning In many real-world scenarios, interested variables are often represented as discretized values due to measurement limitations. Applying Conditional Independence (CI) tests directly to such discretized data, however, can lead to incorrect conclusions. To address this, recent advancements have sought to infer the correct CI relationship between the latent variables through binarizing observed data. However, this process inevitably results in a loss of information, which degrades the test's performance. Motivated by this, this paper introduces a sample-efficient CI test that does not rely on the binarization process. We find that the independence relationships of latent continuous variables can be established by addressing an over-identifying restriction problem with Generalized Method of Moments (GMM). Based on this insight, we derive an appropriate test statistic and establish its asymptotic distribution correctly reflecting CI by leveraging nodewise regression. Theoretical findings and Empirical results across various datasets demonstrate that the superiority and effectiveness of our proposed test. Our code implementation is provided in https://github.com/boyangaaaaa/DCT |
| title | A Sample Efficient Conditional Independence Test in the Presence of Discretization |
| topic | Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2506.08747 |