Outcome-Aware Spectral Feature Learning for Instrumental Variable Regression
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917544792686592 |
|---|---|
| author | Meunier, Dimitri Wornbard, Jakub Kostic, Vladimir R. Moulin, Antoine Fröhlich, Alek Lounici, Karim Pontil, Massimiliano Gretton, Arthur |
| author_facet | Meunier, Dimitri Wornbard, Jakub Kostic, Vladimir R. Moulin, Antoine Fröhlich, Alek Lounici, Karim Pontil, Massimiliano Gretton, Arthur |
| contents | We address the problem of causal effect estimation in the presence of hidden confounders using nonparametric instrumental variable (IV) regression. An established approach is to use estimators based on learned spectral features, that is, features spanning the top singular subspaces of the operator linking treatments to instruments. While powerful, such features are agnostic to the outcome variable. Consequently, the method can fail when the true causal function is poorly represented by these dominant singular functions. To mitigate, we introduce Augmented Spectral Feature Learning, a framework that makes the feature learning process outcome-aware. Our method learns features by minimizing a novel contrastive loss derived from an augmented operator that incorporates information from the outcome. By learning these task-specific features, our approach remains effective even under spectral misalignment. We provide a theoretical analysis of this framework and validate our approach on challenging benchmarks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2512_00919 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Outcome-Aware Spectral Feature Learning for Instrumental Variable Regression Meunier, Dimitri Wornbard, Jakub Kostic, Vladimir R. Moulin, Antoine Fröhlich, Alek Lounici, Karim Pontil, Massimiliano Gretton, Arthur Machine Learning We address the problem of causal effect estimation in the presence of hidden confounders using nonparametric instrumental variable (IV) regression. An established approach is to use estimators based on learned spectral features, that is, features spanning the top singular subspaces of the operator linking treatments to instruments. While powerful, such features are agnostic to the outcome variable. Consequently, the method can fail when the true causal function is poorly represented by these dominant singular functions. To mitigate, we introduce Augmented Spectral Feature Learning, a framework that makes the feature learning process outcome-aware. Our method learns features by minimizing a novel contrastive loss derived from an augmented operator that incorporates information from the outcome. By learning these task-specific features, our approach remains effective even under spectral misalignment. We provide a theoretical analysis of this framework and validate our approach on challenging benchmarks. |
| title | Outcome-Aware Spectral Feature Learning for Instrumental Variable Regression |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2512.00919 |