Scalable Variational Causal Discovery Unconstrained by Acyclicity

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Hoang, Nu, Duong, Bao, Nguyen, Thin
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909299480985600
author Hoang, Nu
Duong, Bao
Nguyen, Thin
author_facet Hoang, Nu
Duong, Bao
Nguyen, Thin
contents Bayesian causal discovery offers the power to quantify epistemic uncertainties among a broad range of structurally diverse causal theories potentially explaining the data, represented in forms of directed acyclic graphs (DAGs). However, existing methods struggle with efficient DAG sampling due to the complex acyclicity constraint. In this study, we propose a scalable Bayesian approach to effectively learn the posterior distribution over causal graphs given observational data thanks to the ability to generate DAGs without explicitly enforcing acyclicity. Specifically, we introduce a novel differentiable DAG sampling method that can generate a valid acyclic causal graph by mapping an unconstrained distribution of implicit topological orders to a distribution over DAGs. Given this efficient DAG sampling scheme, we are able to model the posterior distribution over causal graphs using a simple variational distribution over a continuous domain, which can be learned via the variational inference framework. Extensive empirical experiments on both simulated and real datasets demonstrate the superior performance of the proposed model compared to several state-of-the-art baselines.
format Preprint
id arxiv_https___arxiv_org_abs_2407_04992
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Scalable Variational Causal Discovery Unconstrained by Acyclicity
Hoang, Nu
Duong, Bao
Nguyen, Thin
Machine Learning
Artificial Intelligence
Methodology
Bayesian causal discovery offers the power to quantify epistemic uncertainties among a broad range of structurally diverse causal theories potentially explaining the data, represented in forms of directed acyclic graphs (DAGs). However, existing methods struggle with efficient DAG sampling due to the complex acyclicity constraint. In this study, we propose a scalable Bayesian approach to effectively learn the posterior distribution over causal graphs given observational data thanks to the ability to generate DAGs without explicitly enforcing acyclicity. Specifically, we introduce a novel differentiable DAG sampling method that can generate a valid acyclic causal graph by mapping an unconstrained distribution of implicit topological orders to a distribution over DAGs. Given this efficient DAG sampling scheme, we are able to model the posterior distribution over causal graphs using a simple variational distribution over a continuous domain, which can be learned via the variational inference framework. Extensive empirical experiments on both simulated and real datasets demonstrate the superior performance of the proposed model compared to several state-of-the-art baselines.
title Scalable Variational Causal Discovery Unconstrained by Acyclicity
topic Machine Learning
Artificial Intelligence
Methodology
url https://arxiv.org/abs/2407.04992