MARLIN: Multi-Agent Reinforcement Learning for Incremental DAG Discovery

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Li, Dong, Chen, Zhengzhang, Zhao, Xujiang, Yu, Linlin, Chen, Zhong, He, Yi, Chen, Haifeng, Zhao, Chen
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917355319197696
author Li, Dong
Chen, Zhengzhang
Zhao, Xujiang
Yu, Linlin
Chen, Zhong
He, Yi
Chen, Haifeng
Zhao, Chen
author_facet Li, Dong
Chen, Zhengzhang
Zhao, Xujiang
Yu, Linlin
Chen, Zhong
He, Yi
Chen, Haifeng
Zhao, Chen
contents Uncovering causal structures from observational data is crucial for understanding complex systems and making informed decisions. While reinforcement learning (RL) has shown promise in identifying these structures in the form of a directed acyclic graph (DAG), existing methods often lack efficiency, making them unsuitable for online applications. In this paper, we propose MARLIN, an efficient multi agent RL based approach for incremental DAG learning. MARLIN uses a DAG generation policy that maps a continuous real valued space to the DAG space as an intra batch strategy, then incorporates two RL agents state specific and state invariant to uncover causal relationships and integrates these agents into an incremental learning framework. Furthermore, the framework leverages a factored action space to enhance parallelization efficiency. Extensive experiments on synthetic and real datasets demonstrate that MARLIN outperforms state of the art methods in terms of both efficiency and effectiveness.
format Preprint
id arxiv_https___arxiv_org_abs_2603_20295
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle MARLIN: Multi-Agent Reinforcement Learning for Incremental DAG Discovery
Li, Dong
Chen, Zhengzhang
Zhao, Xujiang
Yu, Linlin
Chen, Zhong
He, Yi
Chen, Haifeng
Zhao, Chen
Machine Learning
Artificial Intelligence
Uncovering causal structures from observational data is crucial for understanding complex systems and making informed decisions. While reinforcement learning (RL) has shown promise in identifying these structures in the form of a directed acyclic graph (DAG), existing methods often lack efficiency, making them unsuitable for online applications. In this paper, we propose MARLIN, an efficient multi agent RL based approach for incremental DAG learning. MARLIN uses a DAG generation policy that maps a continuous real valued space to the DAG space as an intra batch strategy, then incorporates two RL agents state specific and state invariant to uncover causal relationships and integrates these agents into an incremental learning framework. Furthermore, the framework leverages a factored action space to enhance parallelization efficiency. Extensive experiments on synthetic and real datasets demonstrate that MARLIN outperforms state of the art methods in terms of both efficiency and effectiveness.
title MARLIN: Multi-Agent Reinforcement Learning for Incremental DAG Discovery
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2603.20295