Generalization Bounds for Causal Regression: Insights, Guarantees and Sensitivity Analysis
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866917667096494080 |
|---|---|
| author | Csillag, Daniel Struchiner, Claudio José Goedert, Guilherme Tegoni |
| author_facet | Csillag, Daniel Struchiner, Claudio José Goedert, Guilherme Tegoni |
| contents | Many algorithms have been recently proposed for causal machine learning. Yet, there is little to no theory on their quality, especially considering finite samples. In this work, we propose a theory based on generalization bounds that provides such guarantees. By introducing a novel change-of-measure inequality, we are able to tightly bound the model loss in terms of the deviation of the treatment propensities over the population, which we show can be empirically limited. Our theory is fully rigorous and holds even in the face of hidden confounding and violations of positivity. We demonstrate our bounds on semi-synthetic and real data, showcasing their remarkable tightness and practical utility. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_09516 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Generalization Bounds for Causal Regression: Insights, Guarantees and Sensitivity Analysis Csillag, Daniel Struchiner, Claudio José Goedert, Guilherme Tegoni Machine Learning Many algorithms have been recently proposed for causal machine learning. Yet, there is little to no theory on their quality, especially considering finite samples. In this work, we propose a theory based on generalization bounds that provides such guarantees. By introducing a novel change-of-measure inequality, we are able to tightly bound the model loss in terms of the deviation of the treatment propensities over the population, which we show can be empirically limited. Our theory is fully rigorous and holds even in the face of hidden confounding and violations of positivity. We demonstrate our bounds on semi-synthetic and real data, showcasing their remarkable tightness and practical utility. |
| title | Generalization Bounds for Causal Regression: Insights, Guarantees and Sensitivity Analysis |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2405.09516 |