Amortized Causal Discovery with Prior-Fitted Networks

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Sypniewski, Mateusz, Olko, Mateusz, Gajewski, Mateusz, Miłoś, Piotr
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912761260277760
author Sypniewski, Mateusz
Olko, Mateusz
Gajewski, Mateusz
Miłoś, Piotr
author_facet Sypniewski, Mateusz
Olko, Mateusz
Gajewski, Mateusz
Miłoś, Piotr
contents In recent years, differentiable penalized likelihood methods have gained popularity, optimizing the causal structure by maximizing its likelihood with respect to the data. However, recent research has shown that errors in likelihood estimation, even on relatively large sample sizes, disallow the discovery of proper structures. We propose a new approach to amortized causal discovery that addresses the limitations of likelihood estimator accuracy. Our method leverages Prior-Fitted Networks (PFNs) to amortize data-dependent likelihood estimation, yielding more reliable scores for structure learning. Experiments on synthetic, simulated, and real-world datasets show significant gains in structure recovery compared to standard baselines. Furthermore, we demonstrate directly that PFNs provide more accurate likelihood estimates than conventional neural network-based approaches.
format Preprint
id arxiv_https___arxiv_org_abs_2512_11840
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Amortized Causal Discovery with Prior-Fitted Networks
Sypniewski, Mateusz
Olko, Mateusz
Gajewski, Mateusz
Miłoś, Piotr
Machine Learning
Methodology
In recent years, differentiable penalized likelihood methods have gained popularity, optimizing the causal structure by maximizing its likelihood with respect to the data. However, recent research has shown that errors in likelihood estimation, even on relatively large sample sizes, disallow the discovery of proper structures. We propose a new approach to amortized causal discovery that addresses the limitations of likelihood estimator accuracy. Our method leverages Prior-Fitted Networks (PFNs) to amortize data-dependent likelihood estimation, yielding more reliable scores for structure learning. Experiments on synthetic, simulated, and real-world datasets show significant gains in structure recovery compared to standard baselines. Furthermore, we demonstrate directly that PFNs provide more accurate likelihood estimates than conventional neural network-based approaches.
title Amortized Causal Discovery with Prior-Fitted Networks
topic Machine Learning
Methodology
url https://arxiv.org/abs/2512.11840