CORE: Towards Scalable and Efficient Causal Discovery with Reinforcement Learning
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913215515983872 |
|---|---|
| author | Sauter, Andreas W. M. Botteghi, Nicolò Acar, Erman Plaat, Aske |
| author_facet | Sauter, Andreas W. M. Botteghi, Nicolò Acar, Erman Plaat, Aske |
| contents | Causal discovery is the challenging task of inferring causal structure from data. Motivated by Pearl's Causal Hierarchy (PCH), which tells us that passive observations alone are not enough to distinguish correlation from causation, there has been a recent push to incorporate interventions into machine learning research. Reinforcement learning provides a convenient framework for such an active approach to learning. This paper presents CORE, a deep reinforcement learning-based approach for causal discovery and intervention planning. CORE learns to sequentially reconstruct causal graphs from data while learning to perform informative interventions. Our results demonstrate that CORE generalizes to unseen graphs and efficiently uncovers causal structures. Furthermore, CORE scales to larger graphs with up to 10 variables and outperforms existing approaches in structure estimation accuracy and sample efficiency. All relevant code and supplementary material can be found at https://github.com/sa-and/CORE |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_16974 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | CORE: Towards Scalable and Efficient Causal Discovery with Reinforcement Learning Sauter, Andreas W. M. Botteghi, Nicolò Acar, Erman Plaat, Aske Machine Learning Artificial Intelligence I.2.6; I.2.8 Causal discovery is the challenging task of inferring causal structure from data. Motivated by Pearl's Causal Hierarchy (PCH), which tells us that passive observations alone are not enough to distinguish correlation from causation, there has been a recent push to incorporate interventions into machine learning research. Reinforcement learning provides a convenient framework for such an active approach to learning. This paper presents CORE, a deep reinforcement learning-based approach for causal discovery and intervention planning. CORE learns to sequentially reconstruct causal graphs from data while learning to perform informative interventions. Our results demonstrate that CORE generalizes to unseen graphs and efficiently uncovers causal structures. Furthermore, CORE scales to larger graphs with up to 10 variables and outperforms existing approaches in structure estimation accuracy and sample efficiency. All relevant code and supplementary material can be found at https://github.com/sa-and/CORE |
| title | CORE: Towards Scalable and Efficient Causal Discovery with Reinforcement Learning |
| topic | Machine Learning Artificial Intelligence I.2.6; I.2.8 |
| url | https://arxiv.org/abs/2401.16974 |