Prediction-Powered Causal Inferences
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915572630945792 |
|---|---|
| author | Cadei, Riccardo Demirel, Ilker De Bartolomeis, Piersilvio Lindorfer, Lukas Cremer, Sylvia Schmid, Cordelia Locatello, Francesco |
| author_facet | Cadei, Riccardo Demirel, Ilker De Bartolomeis, Piersilvio Lindorfer, Lukas Cremer, Sylvia Schmid, Cordelia Locatello, Francesco |
| contents | In many scientific experiments, the data annotating cost constraints the pace for testing novel hypotheses. Yet, modern machine learning pipelines offer a promising solution, provided their predictions yield correct conclusions. We focus on Prediction-Powered Causal Inferences (PPCI), i.e., estimating the treatment effect in an unlabeled target experiment, relying on training data with the same outcome annotated but potentially different treatment or effect modifiers. We first show that conditional calibration guarantees valid PPCI at population level. Then, we introduce a sufficient representation constraint transferring validity across experiments, which we propose to enforce in practice in Deconfounded Empirical Risk Minimization, our new model-agnostic training objective. We validate our method on synthetic and real-world scientific data, solving impossible problem instances for Empirical Risk Minimization even with standard invariance constraints. In particular, for the first time, we achieve valid causal inference on a scientific experiment with complex recording and no human annotations, fine-tuning a foundational model on our similar annotated experiment. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_06343 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Prediction-Powered Causal Inferences Cadei, Riccardo Demirel, Ilker De Bartolomeis, Piersilvio Lindorfer, Lukas Cremer, Sylvia Schmid, Cordelia Locatello, Francesco Machine Learning In many scientific experiments, the data annotating cost constraints the pace for testing novel hypotheses. Yet, modern machine learning pipelines offer a promising solution, provided their predictions yield correct conclusions. We focus on Prediction-Powered Causal Inferences (PPCI), i.e., estimating the treatment effect in an unlabeled target experiment, relying on training data with the same outcome annotated but potentially different treatment or effect modifiers. We first show that conditional calibration guarantees valid PPCI at population level. Then, we introduce a sufficient representation constraint transferring validity across experiments, which we propose to enforce in practice in Deconfounded Empirical Risk Minimization, our new model-agnostic training objective. We validate our method on synthetic and real-world scientific data, solving impossible problem instances for Empirical Risk Minimization even with standard invariance constraints. In particular, for the first time, we achieve valid causal inference on a scientific experiment with complex recording and no human annotations, fine-tuning a foundational model on our similar annotated experiment. |
| title | Prediction-Powered Causal Inferences |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2502.06343 |