CausalEval: Towards Better Causal Reasoning in Language Models
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866913694935416832 |
|---|---|
| author | Yu, Longxuan Chen, Delin Xiong, Siheng Wu, Qingyang Liu, Qingzhen Li, Dawei Chen, Zhikai Liu, Xiaoze Pan, Liangming |
| author_facet | Yu, Longxuan Chen, Delin Xiong, Siheng Wu, Qingyang Liu, Qingzhen Li, Dawei Chen, Zhikai Liu, Xiaoze Pan, Liangming |
| contents | Causal reasoning (CR) is a crucial aspect of intelligence, essential for problem-solving, decision-making, and understanding the world. While language models (LMs) can generate rationales for their outputs, their ability to reliably perform causal reasoning remains uncertain, often falling short in tasks requiring a deep understanding of causality. In this paper, we introduce CausalEval, a comprehensive review of research aimed at enhancing LMs for causal reasoning, coupled with an empirical evaluation of current models and methods. We categorize existing methods based on the role of LMs: either as reasoning engines or as helpers providing knowledge or data to traditional CR methods, followed by a detailed discussion of methodologies in each category. We then assess the performance of current LMs and various enhancement methods on a range of causal reasoning tasks, providing key findings and in-depth analysis. Finally, we present insights from current studies and highlight promising directions for future research. We aim for this work to serve as a comprehensive resource, fostering further advancements in causal reasoning with LMs. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_16676 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | CausalEval: Towards Better Causal Reasoning in Language Models Yu, Longxuan Chen, Delin Xiong, Siheng Wu, Qingyang Liu, Qingzhen Li, Dawei Chen, Zhikai Liu, Xiaoze Pan, Liangming Artificial Intelligence Computation and Language Causal reasoning (CR) is a crucial aspect of intelligence, essential for problem-solving, decision-making, and understanding the world. While language models (LMs) can generate rationales for their outputs, their ability to reliably perform causal reasoning remains uncertain, often falling short in tasks requiring a deep understanding of causality. In this paper, we introduce CausalEval, a comprehensive review of research aimed at enhancing LMs for causal reasoning, coupled with an empirical evaluation of current models and methods. We categorize existing methods based on the role of LMs: either as reasoning engines or as helpers providing knowledge or data to traditional CR methods, followed by a detailed discussion of methodologies in each category. We then assess the performance of current LMs and various enhancement methods on a range of causal reasoning tasks, providing key findings and in-depth analysis. Finally, we present insights from current studies and highlight promising directions for future research. We aim for this work to serve as a comprehensive resource, fostering further advancements in causal reasoning with LMs. |
| title | CausalEval: Towards Better Causal Reasoning in Language Models |
| topic | Artificial Intelligence Computation and Language |
| url | https://arxiv.org/abs/2410.16676 |