ACTIVA: Amortized Causal Effect Estimation via Transformer-based Variational Autoencoder
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866911097118785536 |
|---|---|
| author | Sauter, Andreas Salehkaleybar, Saber Plaat, Aske Acar, Erman |
| author_facet | Sauter, Andreas Salehkaleybar, Saber Plaat, Aske Acar, Erman |
| contents | Predicting the distribution of outcomes under hypothetical interventions is crucial across healthcare, economics, and policy-making. However, existing methods often require restrictive assumptions, and are typically limited by the lack of amortization across problem instances. We propose ACTIVA, a transformer-based conditional variational autoencoder (VAE) architecture for amortized causal inference, which estimates interventional distributions directly from observational data without. ACTIVA learns a latent representation conditioned on observational inputs and intervention queries, enabling zero-shot inference by amortizing causal knowledge from diverse training scenarios. We provide theoretical insights showing that ACTIVA predicts interventional distributions as mixtures over observationally equivalent causal models. Empirical evaluations on synthetic and semi-synthetic datasets confirm the effectiveness of our amortized approach and highlight promising directions for future real-world applications. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_01290 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | ACTIVA: Amortized Causal Effect Estimation via Transformer-based Variational Autoencoder Sauter, Andreas Salehkaleybar, Saber Plaat, Aske Acar, Erman Machine Learning Artificial Intelligence Predicting the distribution of outcomes under hypothetical interventions is crucial across healthcare, economics, and policy-making. However, existing methods often require restrictive assumptions, and are typically limited by the lack of amortization across problem instances. We propose ACTIVA, a transformer-based conditional variational autoencoder (VAE) architecture for amortized causal inference, which estimates interventional distributions directly from observational data without. ACTIVA learns a latent representation conditioned on observational inputs and intervention queries, enabling zero-shot inference by amortizing causal knowledge from diverse training scenarios. We provide theoretical insights showing that ACTIVA predicts interventional distributions as mixtures over observationally equivalent causal models. Empirical evaluations on synthetic and semi-synthetic datasets confirm the effectiveness of our amortized approach and highlight promising directions for future real-world applications. |
| title | ACTIVA: Amortized Causal Effect Estimation via Transformer-based Variational Autoencoder |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2503.01290 |