Large Causal Models for Temporal Causal Discovery

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kougioulis, Nikolaos, Gkorgkolis, Nikolaos, Wang, MingXue, Caglayan, Bora, Simionato, Dario, Tonon, Andrea, Tsamardinos, Ioannis
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912917341863936
author Kougioulis, Nikolaos
Gkorgkolis, Nikolaos
Wang, MingXue
Caglayan, Bora
Simionato, Dario
Tonon, Andrea
Tsamardinos, Ioannis
author_facet Kougioulis, Nikolaos
Gkorgkolis, Nikolaos
Wang, MingXue
Caglayan, Bora
Simionato, Dario
Tonon, Andrea
Tsamardinos, Ioannis
contents Causal discovery for both cross-sectional and temporal data has traditionally followed a dataset-specific paradigm, where a new model is fitted for each individual dataset. Such an approach limits the potential of multi-dataset pretraining. The concept of large causal models (LCMs) envisions a class of pre-trained neural architectures specifically designed for temporal causal discovery. Prior approaches are constrained to small variable counts, degrade with larger inputs, and rely heavily on synthetic data, limiting generalization. We propose a principled framework for LCMs, combining diverse synthetic generators with realistic time-series datasets, allowing learning at scale. Extensive experiments on synthetic, semi-synthetic and realistic benchmarks show that LCMs scale effectively to higher variable counts and deeper architectures while maintaining strong performance. Trained models achieve competitive or superior accuracy compared to classical and neural baselines, particularly in out-of-distribution settings, while enabling fast, single-pass inference. Results demonstrate LCMs as a promising foundation-model paradigm for temporal causal discovery. Experiments and model weights are available at https://github.com/kougioulis/LCM-paper/.
format Preprint
id arxiv_https___arxiv_org_abs_2602_18662
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Large Causal Models for Temporal Causal Discovery
Kougioulis, Nikolaos
Gkorgkolis, Nikolaos
Wang, MingXue
Caglayan, Bora
Simionato, Dario
Tonon, Andrea
Tsamardinos, Ioannis
Machine Learning
Causal discovery for both cross-sectional and temporal data has traditionally followed a dataset-specific paradigm, where a new model is fitted for each individual dataset. Such an approach limits the potential of multi-dataset pretraining. The concept of large causal models (LCMs) envisions a class of pre-trained neural architectures specifically designed for temporal causal discovery. Prior approaches are constrained to small variable counts, degrade with larger inputs, and rely heavily on synthetic data, limiting generalization. We propose a principled framework for LCMs, combining diverse synthetic generators with realistic time-series datasets, allowing learning at scale. Extensive experiments on synthetic, semi-synthetic and realistic benchmarks show that LCMs scale effectively to higher variable counts and deeper architectures while maintaining strong performance. Trained models achieve competitive or superior accuracy compared to classical and neural baselines, particularly in out-of-distribution settings, while enabling fast, single-pass inference. Results demonstrate LCMs as a promising foundation-model paradigm for temporal causal discovery. Experiments and model weights are available at https://github.com/kougioulis/LCM-paper/.
title Large Causal Models for Temporal Causal Discovery
topic Machine Learning
url https://arxiv.org/abs/2602.18662