CauSim: Scaling Causal Reasoning with Increasingly Complex Causal Simulators

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Astorga, Nicolás, Kriz, Anita, van der Schaar, Mihaela
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909029908873216
author Astorga, Nicolás
Kriz, Anita
van der Schaar, Mihaela
author_facet Astorga, Nicolás
Kriz, Anita
van der Schaar, Mihaela
contents Despite surpassing human performance across mathematics, coding, and other knowledge-intensive tasks, large language models (LLMs) continue to struggle with causal reasoning. A core obstacle is the target data itself: causal systems are complex and often expressed in non-executable forms, while ground-truth answers to causal queries are inherently scarce. We introduce CauSim, a framework that turns causal reasoning from a scarce-label problem into a scalable supervised one. CauSim constructs increasingly complex causal simulators: executable structural causal models (SCMs), incrementally built by LLMs, that scale to globally complex systems while maintaining verifiable answers to causal queries. CauSim operates across representations by formalizing non-executable causal knowledge into code, enabling data augmentation, and translating executable SCMs into natural language, enabling supervision in previously difficult-to-supervise representations. We structure our research into two parts: (1) how to construct increasingly complex causal simulators, and (2) a systematic study of what CauSim enables, demonstrating generalization across representations, consistent gains from curriculum scaling and data volume, LLM self-improvement through self-generated simulators, and data augmentation via formalization of existing domain knowledge.
format Preprint
id arxiv_https___arxiv_org_abs_2605_09079
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle CauSim: Scaling Causal Reasoning with Increasingly Complex Causal Simulators
Astorga, Nicolás
Kriz, Anita
van der Schaar, Mihaela
Artificial Intelligence
Despite surpassing human performance across mathematics, coding, and other knowledge-intensive tasks, large language models (LLMs) continue to struggle with causal reasoning. A core obstacle is the target data itself: causal systems are complex and often expressed in non-executable forms, while ground-truth answers to causal queries are inherently scarce. We introduce CauSim, a framework that turns causal reasoning from a scarce-label problem into a scalable supervised one. CauSim constructs increasingly complex causal simulators: executable structural causal models (SCMs), incrementally built by LLMs, that scale to globally complex systems while maintaining verifiable answers to causal queries. CauSim operates across representations by formalizing non-executable causal knowledge into code, enabling data augmentation, and translating executable SCMs into natural language, enabling supervision in previously difficult-to-supervise representations. We structure our research into two parts: (1) how to construct increasingly complex causal simulators, and (2) a systematic study of what CauSim enables, demonstrating generalization across representations, consistent gains from curriculum scaling and data volume, LLM self-improvement through self-generated simulators, and data augmentation via formalization of existing domain knowledge.
title CauSim: Scaling Causal Reasoning with Increasingly Complex Causal Simulators
topic Artificial Intelligence
url https://arxiv.org/abs/2605.09079