Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2510.20295 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914109056876544 |
|---|---|
| author | Qiu, Yang Zou, Yixiong Wang, Jun Liu, Wei Fu, Xiangyu Li, Ruixuan |
| author_facet | Qiu, Yang Zou, Yixiong Wang, Jun Liu, Wei Fu, Xiangyu Li, Ruixuan |
| contents | Out-of-distribution generalization under distributional shifts remains a critical challenge for graph neural networks. Existing methods generally adopt the Invariant Risk Minimization (IRM) framework, requiring costly environment annotations or heuristically generated synthetic splits. To circumvent these limitations, in this work, we aim to develop an IRM-free method for capturing causal subgraphs. We first identify that causal subgraphs exhibit substantially smaller distributional variations than non-causal components across diverse environments, which we formalize as the Invariant Distribution Criterion and theoretically prove in this paper. Building on this criterion, we systematically uncover the quantitative relationship between distributional shift and representation norm for identifying the causal subgraph, and investigate its underlying mechanisms in depth. Finally, we propose an IRM-free method by introducing a norm-guided invariant distribution objective for causal subgraph discovery and prediction. Extensive experiments on two widely used benchmarks demonstrate that our method consistently outperforms state-of-the-art methods in graph generalization. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_20295 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Quantifying Distributional Invariance in Causal Subgraph for IRM-Free Graph Generalization Qiu, Yang Zou, Yixiong Wang, Jun Liu, Wei Fu, Xiangyu Li, Ruixuan Machine Learning Out-of-distribution generalization under distributional shifts remains a critical challenge for graph neural networks. Existing methods generally adopt the Invariant Risk Minimization (IRM) framework, requiring costly environment annotations or heuristically generated synthetic splits. To circumvent these limitations, in this work, we aim to develop an IRM-free method for capturing causal subgraphs. We first identify that causal subgraphs exhibit substantially smaller distributional variations than non-causal components across diverse environments, which we formalize as the Invariant Distribution Criterion and theoretically prove in this paper. Building on this criterion, we systematically uncover the quantitative relationship between distributional shift and representation norm for identifying the causal subgraph, and investigate its underlying mechanisms in depth. Finally, we propose an IRM-free method by introducing a norm-guided invariant distribution objective for causal subgraph discovery and prediction. Extensive experiments on two widely used benchmarks demonstrate that our method consistently outperforms state-of-the-art methods in graph generalization. |
| title | Quantifying Distributional Invariance in Causal Subgraph for IRM-Free Graph Generalization |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2510.20295 |