Entropic Causal Inference: Graph Identifiability

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Compton, Spencer, Greenewald, Kristjan, Katz, Dmitriy, Kocaoglu, Murat
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909798442729472
author Compton, Spencer
Greenewald, Kristjan
Katz, Dmitriy
Kocaoglu, Murat
author_facet Compton, Spencer
Greenewald, Kristjan
Katz, Dmitriy
Kocaoglu, Murat
contents Entropic causal inference is a recent framework for learning the causal graph between two variables from observational data by finding the information-theoretically simplest structural explanation of the data, i.e., the model with smallest entropy. In our work, we first extend the causal graph identifiability result in the two-variable setting under relaxed assumptions. We then show the first identifiability result using the entropic approach for learning causal graphs with more than two nodes. Our approach utilizes the property that ancestrality between a source node and its descendants can be determined using the bivariate entropic tests. We provide a sound sequential peeling algorithm for general graphs that relies on this property. We also propose a heuristic algorithm for small graphs that shows strong empirical performance. We rigorously evaluate the performance of our algorithms on synthetic data generated from a variety of models, observing improvement over prior work. Finally we test our algorithms on real-world datasets.
format Preprint
id arxiv_https___arxiv_org_abs_2509_16463
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Entropic Causal Inference: Graph Identifiability
Compton, Spencer
Greenewald, Kristjan
Katz, Dmitriy
Kocaoglu, Murat
Machine Learning
Artificial Intelligence
Entropic causal inference is a recent framework for learning the causal graph between two variables from observational data by finding the information-theoretically simplest structural explanation of the data, i.e., the model with smallest entropy. In our work, we first extend the causal graph identifiability result in the two-variable setting under relaxed assumptions. We then show the first identifiability result using the entropic approach for learning causal graphs with more than two nodes. Our approach utilizes the property that ancestrality between a source node and its descendants can be determined using the bivariate entropic tests. We provide a sound sequential peeling algorithm for general graphs that relies on this property. We also propose a heuristic algorithm for small graphs that shows strong empirical performance. We rigorously evaluate the performance of our algorithms on synthetic data generated from a variety of models, observing improvement over prior work. Finally we test our algorithms on real-world datasets.
title Entropic Causal Inference: Graph Identifiability
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2509.16463