Saved in:
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2412.17963 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915884013977600 |
|---|---|
| author | Zhang, Ge Alomrani, Mohammad Ali Gu, Hongjian Zhou, Jiaming Hu, Yaochen Wang, Bin Liu, Qun Coates, Mark Zhang, Yingxue Hao, Jianye |
| author_facet | Zhang, Ge Alomrani, Mohammad Ali Gu, Hongjian Zhou, Jiaming Hu, Yaochen Wang, Bin Liu, Qun Coates, Mark Zhang, Yingxue Hao, Jianye |
| contents | Large language models (LLMs) possess vast semantic knowledge but often struggle with complex reasoning tasks, particularly in relational reasoning problems such as kinship or spatial reasoning. In this paper, we present Path-of-Thoughts (PoT), a novel framework for solving relation reasoning that decomposes the task into three key stages: graph extraction, path identification, and reasoning. Unlike previous approaches, PoT efficiently extracts a reasoning graph that identifies crucial entities, relations, and attributes within the context. Subsequently, PoT identifies query-relevant reasoning paths within the graph, facilitating downstream reasoning of potential answers. Experimental evaluations across four datasets of relational reasoning demonstrate that PoT surpasses state-of-the-art baselines by a significant margin (up to 21.3%) without requiring fine-tuning or extensive LLM calls. Furthermore, unlike prior neuro-symbolic methods, PoT exhibits improved resilience against LLM extraction errors and input ambiguity by leveraging the compositional nature of graphs. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_17963 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Extracting and Following Paths for Robust Relational Reasoning with Large Language Models Zhang, Ge Alomrani, Mohammad Ali Gu, Hongjian Zhou, Jiaming Hu, Yaochen Wang, Bin Liu, Qun Coates, Mark Zhang, Yingxue Hao, Jianye Computation and Language Large language models (LLMs) possess vast semantic knowledge but often struggle with complex reasoning tasks, particularly in relational reasoning problems such as kinship or spatial reasoning. In this paper, we present Path-of-Thoughts (PoT), a novel framework for solving relation reasoning that decomposes the task into three key stages: graph extraction, path identification, and reasoning. Unlike previous approaches, PoT efficiently extracts a reasoning graph that identifies crucial entities, relations, and attributes within the context. Subsequently, PoT identifies query-relevant reasoning paths within the graph, facilitating downstream reasoning of potential answers. Experimental evaluations across four datasets of relational reasoning demonstrate that PoT surpasses state-of-the-art baselines by a significant margin (up to 21.3%) without requiring fine-tuning or extensive LLM calls. Furthermore, unlike prior neuro-symbolic methods, PoT exhibits improved resilience against LLM extraction errors and input ambiguity by leveraging the compositional nature of graphs. |
| title | Extracting and Following Paths for Robust Relational Reasoning with Large Language Models |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2412.17963 |