Causal vs. Anticausal merging of predictors
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866916566784802816 |
|---|---|
| author | Mejia, Sergio Hernan Garrido Blöbaum, Patrick Schölkopf, Bernhard Janzing, Dominik |
| author_facet | Mejia, Sergio Hernan Garrido Blöbaum, Patrick Schölkopf, Bernhard Janzing, Dominik |
| contents | We study the differences arising from merging predictors in the causal and anticausal directions using the same data. In particular we study the asymmetries that arise in a simple model where we merge the predictors using one binary variable as target and two continuous variables as predictors. We use Causal Maximum Entropy (CMAXENT) as inductive bias to merge the predictors, however, we expect similar differences to hold also when we use other merging methods that take into account asymmetries between cause and effect. We show that if we observe all bivariate distributions, the CMAXENT solution reduces to a logistic regression in the causal direction and Linear Discriminant Analysis (LDA) in the anticausal direction. Furthermore, we study how the decision boundaries of these two solutions differ whenever we observe only some of the bivariate distributions implications for Out-Of-Variable (OOV) generalisation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_08426 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Causal vs. Anticausal merging of predictors Mejia, Sergio Hernan Garrido Blöbaum, Patrick Schölkopf, Bernhard Janzing, Dominik Machine Learning Artificial Intelligence Methodology We study the differences arising from merging predictors in the causal and anticausal directions using the same data. In particular we study the asymmetries that arise in a simple model where we merge the predictors using one binary variable as target and two continuous variables as predictors. We use Causal Maximum Entropy (CMAXENT) as inductive bias to merge the predictors, however, we expect similar differences to hold also when we use other merging methods that take into account asymmetries between cause and effect. We show that if we observe all bivariate distributions, the CMAXENT solution reduces to a logistic regression in the causal direction and Linear Discriminant Analysis (LDA) in the anticausal direction. Furthermore, we study how the decision boundaries of these two solutions differ whenever we observe only some of the bivariate distributions implications for Out-Of-Variable (OOV) generalisation. |
| title | Causal vs. Anticausal merging of predictors |
| topic | Machine Learning Artificial Intelligence Methodology |
| url | https://arxiv.org/abs/2501.08426 |