Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2408.03608 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910573016383488 |
|---|---|
| author | Tang, Luyao Yuan, Yuxuan Chen, Chaoqi Ding, Xinghao Huang, Yue |
| author_facet | Tang, Luyao Yuan, Yuxuan Chen, Chaoqi Ding, Xinghao Huang, Yue |
| contents | Despite the considerable advancements achieved by deep neural networks, their performance tends to degenerate when the test environment diverges from the training ones. Domain generalization (DG) solves this issue by learning representations independent of domain-related information, thus facilitating extrapolation to unseen environments. Existing approaches typically focus on formulating tailored training objectives to extract shared features from the source data. However, the disjointed training and testing procedures may compromise robustness, particularly in the face of unforeseen variations during deployment. In this paper, we propose a novel and holistic framework based on causality, named InPer, designed to enhance model generalization by incorporating causal intervention during training and causal perturbation during testing. Specifically, during the training phase, we employ entropy-based causal intervention (EnIn) to refine the selection of causal variables. To identify samples with anti-interference causal variables from the target domain, we propose a novel metric, homeostatic score, through causal perturbation (HoPer) to construct a prototype classifier in test time. Experimental results across multiple cross-domain tasks confirm the efficacy of InPer. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_03608 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Mixstyle-Entropy: Domain Generalization with Causal Intervention and Perturbation Tang, Luyao Yuan, Yuxuan Chen, Chaoqi Ding, Xinghao Huang, Yue Machine Learning Computer Vision and Pattern Recognition Methodology Despite the considerable advancements achieved by deep neural networks, their performance tends to degenerate when the test environment diverges from the training ones. Domain generalization (DG) solves this issue by learning representations independent of domain-related information, thus facilitating extrapolation to unseen environments. Existing approaches typically focus on formulating tailored training objectives to extract shared features from the source data. However, the disjointed training and testing procedures may compromise robustness, particularly in the face of unforeseen variations during deployment. In this paper, we propose a novel and holistic framework based on causality, named InPer, designed to enhance model generalization by incorporating causal intervention during training and causal perturbation during testing. Specifically, during the training phase, we employ entropy-based causal intervention (EnIn) to refine the selection of causal variables. To identify samples with anti-interference causal variables from the target domain, we propose a novel metric, homeostatic score, through causal perturbation (HoPer) to construct a prototype classifier in test time. Experimental results across multiple cross-domain tasks confirm the efficacy of InPer. |
| title | Mixstyle-Entropy: Domain Generalization with Causal Intervention and Perturbation |
| topic | Machine Learning Computer Vision and Pattern Recognition Methodology |
| url | https://arxiv.org/abs/2408.03608 |