Enregistré dans:
Détails bibliographiques
Auteurs principaux: Wang, Yuanchao, Lai, Zhao-Rong, Zhong, Tianqi, Li, Fengnan
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:https://arxiv.org/abs/2601.22944
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866910008324653056
author Wang, Yuanchao
Lai, Zhao-Rong
Zhong, Tianqi
Li, Fengnan
author_facet Wang, Yuanchao
Lai, Zhao-Rong
Zhong, Tianqi
Li, Fengnan
contents Out-of-distribution (OOD) generalization remains challenging when models simultaneously encounter correlation shifts across environments and diversity shifts driven by rare or hard samples. Existing invariant risk minimization (IRM) methods primarily address spurious correlations at the environment level, but often overlook sample-level heterogeneity within environments, which can critically impact OOD performance. In this work, we propose Environment-Conditioned Tail Reweighting for Total Variation Invariant Risk Minimization (ECTR), a unified framework that augments TV-based invariant learning with environment-conditioned tail reweighting to jointly address both types of distribution shift. By integrating environment-level invariance with within-environment robustness, the proposed approach makes these two mechanisms complementary under mixed distribution shifts. We further extend the framework to scenarios without explicit environment annotations by inferring latent environments through a minimax formulation. Experiments across regression, tabular, time-series, and image classification benchmarks under mixed distribution shifts demonstrate consistent improvements in both worst-environment and average OOD performance.
format Preprint
id arxiv_https___arxiv_org_abs_2601_22944
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Environment-Conditioned Tail Reweighting for Total Variation Invariant Risk Minimization
Wang, Yuanchao
Lai, Zhao-Rong
Zhong, Tianqi
Li, Fengnan
Machine Learning
I.2
Out-of-distribution (OOD) generalization remains challenging when models simultaneously encounter correlation shifts across environments and diversity shifts driven by rare or hard samples. Existing invariant risk minimization (IRM) methods primarily address spurious correlations at the environment level, but often overlook sample-level heterogeneity within environments, which can critically impact OOD performance. In this work, we propose Environment-Conditioned Tail Reweighting for Total Variation Invariant Risk Minimization (ECTR), a unified framework that augments TV-based invariant learning with environment-conditioned tail reweighting to jointly address both types of distribution shift. By integrating environment-level invariance with within-environment robustness, the proposed approach makes these two mechanisms complementary under mixed distribution shifts. We further extend the framework to scenarios without explicit environment annotations by inferring latent environments through a minimax formulation. Experiments across regression, tabular, time-series, and image classification benchmarks under mixed distribution shifts demonstrate consistent improvements in both worst-environment and average OOD performance.
title Environment-Conditioned Tail Reweighting for Total Variation Invariant Risk Minimization
topic Machine Learning
I.2
url https://arxiv.org/abs/2601.22944