Causal Layering via Conditional Entropy

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Feigenbaum, Itai, Arpit, Devansh, Wang, Huan, Heinecke, Shelby, Niebles, Juan Carlos, Yao, Weiran, Xiong, Caiming, Savarese, Silvio
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913200450043904
author Feigenbaum, Itai
Arpit, Devansh
Wang, Huan
Heinecke, Shelby
Niebles, Juan Carlos
Yao, Weiran
Xiong, Caiming
Savarese, Silvio
author_facet Feigenbaum, Itai
Arpit, Devansh
Wang, Huan
Heinecke, Shelby
Niebles, Juan Carlos
Yao, Weiran
Xiong, Caiming
Savarese, Silvio
contents Causal discovery aims to recover information about an unobserved causal graph from the observable data it generates. Layerings are orderings of the variables which place causes before effects. In this paper, we provide ways to recover layerings of a graph by accessing the data via a conditional entropy oracle, when distributions are discrete. Our algorithms work by repeatedly removing sources or sinks from the graph. Under appropriate assumptions and conditioning, we can separate the sources or sinks from the remainder of the nodes by comparing their conditional entropy to the unconditional entropy of their noise. Our algorithms are provably correct and run in worst-case quadratic time. The main assumptions are faithfulness and injective noise, and either known noise entropies or weakly monotonically increasing noise entropies along directed paths. In addition, we require one of either a very mild extension of faithfulness, or strictly monotonically increasing noise entropies, or expanding noise injectivity to include an additional single argument in the structural functions.
format Preprint
id arxiv_https___arxiv_org_abs_2401_10495
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Causal Layering via Conditional Entropy
Feigenbaum, Itai
Arpit, Devansh
Wang, Huan
Heinecke, Shelby
Niebles, Juan Carlos
Yao, Weiran
Xiong, Caiming
Savarese, Silvio
Machine Learning
Artificial Intelligence
Methodology
Causal discovery aims to recover information about an unobserved causal graph from the observable data it generates. Layerings are orderings of the variables which place causes before effects. In this paper, we provide ways to recover layerings of a graph by accessing the data via a conditional entropy oracle, when distributions are discrete. Our algorithms work by repeatedly removing sources or sinks from the graph. Under appropriate assumptions and conditioning, we can separate the sources or sinks from the remainder of the nodes by comparing their conditional entropy to the unconditional entropy of their noise. Our algorithms are provably correct and run in worst-case quadratic time. The main assumptions are faithfulness and injective noise, and either known noise entropies or weakly monotonically increasing noise entropies along directed paths. In addition, we require one of either a very mild extension of faithfulness, or strictly monotonically increasing noise entropies, or expanding noise injectivity to include an additional single argument in the structural functions.
title Causal Layering via Conditional Entropy
topic Machine Learning
Artificial Intelligence
Methodology
url https://arxiv.org/abs/2401.10495