Efficient Causal Graph Discovery Using Large Language Models

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Jiralerspong, Thomas, Chen, Xiaoyin, More, Yash, Shah, Vedant, Bengio, Yoshua
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866911563866177536
author Jiralerspong, Thomas
Chen, Xiaoyin
More, Yash
Shah, Vedant
Bengio, Yoshua
author_facet Jiralerspong, Thomas
Chen, Xiaoyin
More, Yash
Shah, Vedant
Bengio, Yoshua
contents We propose a novel framework that leverages LLMs for full causal graph discovery. While previous LLM-based methods have used a pairwise query approach, this requires a quadratic number of queries which quickly becomes impractical for larger causal graphs. In contrast, the proposed framework uses a breadth-first search (BFS) approach which allows it to use only a linear number of queries. We also show that the proposed method can easily incorporate observational data when available, to improve performance. In addition to being more time and data-efficient, the proposed framework achieves state-of-the-art results on real-world causal graphs of varying sizes. The results demonstrate the effectiveness and efficiency of the proposed method in discovering causal relationships, showcasing its potential for broad applicability in causal graph discovery tasks across different domains.
format Preprint
id arxiv_https___arxiv_org_abs_2402_01207
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Efficient Causal Graph Discovery Using Large Language Models
Jiralerspong, Thomas
Chen, Xiaoyin
More, Yash
Shah, Vedant
Bengio, Yoshua
Machine Learning
Artificial Intelligence
Methodology
We propose a novel framework that leverages LLMs for full causal graph discovery. While previous LLM-based methods have used a pairwise query approach, this requires a quadratic number of queries which quickly becomes impractical for larger causal graphs. In contrast, the proposed framework uses a breadth-first search (BFS) approach which allows it to use only a linear number of queries. We also show that the proposed method can easily incorporate observational data when available, to improve performance. In addition to being more time and data-efficient, the proposed framework achieves state-of-the-art results on real-world causal graphs of varying sizes. The results demonstrate the effectiveness and efficiency of the proposed method in discovering causal relationships, showcasing its potential for broad applicability in causal graph discovery tasks across different domains.
title Efficient Causal Graph Discovery Using Large Language Models
topic Machine Learning
Artificial Intelligence
Methodology
url https://arxiv.org/abs/2402.01207