Ontology-Guided Reverse Thinking Makes Large Language Models Stronger on Knowledge Graph Question Answering

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Liu, Runxuan, Luo, Bei, Li, Jiaqi, Wang, Baoxin, Liu, Ming, Wu, Dayong, Wang, Shijin, Qin, Bing
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866918128086155264
author Liu, Runxuan
Luo, Bei
Li, Jiaqi
Wang, Baoxin
Liu, Ming
Wu, Dayong
Wang, Shijin
Qin, Bing
author_facet Liu, Runxuan
Luo, Bei
Li, Jiaqi
Wang, Baoxin
Liu, Ming
Wu, Dayong
Wang, Shijin
Qin, Bing
contents Large language models (LLMs) have shown remarkable capabilities in natural language processing. However, in knowledge graph question answering tasks (KGQA), there remains the issue of answering questions that require multi-hop reasoning. Existing methods rely on entity vector matching, but the purpose of the question is abstract and difficult to match with specific entities. As a result, it is difficult to establish reasoning paths to the purpose, which leads to information loss and redundancy. To address this issue, inspired by human reverse thinking, we propose Ontology-Guided Reverse Thinking (ORT), a novel framework that constructs reasoning paths from purposes back to conditions. ORT operates in three key phases: (1) using LLM to extract purpose labels and condition labels, (2) constructing label reasoning paths based on the KG ontology, and (3) using the label reasoning paths to guide knowledge retrieval. Experiments on the WebQSP and CWQ datasets show that ORT achieves state-of-the-art performance and significantly enhances the capability of LLMs for KGQA.
format Preprint
id arxiv_https___arxiv_org_abs_2502_11491
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Ontology-Guided Reverse Thinking Makes Large Language Models Stronger on Knowledge Graph Question Answering
Liu, Runxuan
Luo, Bei
Li, Jiaqi
Wang, Baoxin
Liu, Ming
Wu, Dayong
Wang, Shijin
Qin, Bing
Computation and Language
Artificial Intelligence
Large language models (LLMs) have shown remarkable capabilities in natural language processing. However, in knowledge graph question answering tasks (KGQA), there remains the issue of answering questions that require multi-hop reasoning. Existing methods rely on entity vector matching, but the purpose of the question is abstract and difficult to match with specific entities. As a result, it is difficult to establish reasoning paths to the purpose, which leads to information loss and redundancy. To address this issue, inspired by human reverse thinking, we propose Ontology-Guided Reverse Thinking (ORT), a novel framework that constructs reasoning paths from purposes back to conditions. ORT operates in three key phases: (1) using LLM to extract purpose labels and condition labels, (2) constructing label reasoning paths based on the KG ontology, and (3) using the label reasoning paths to guide knowledge retrieval. Experiments on the WebQSP and CWQ datasets show that ORT achieves state-of-the-art performance and significantly enhances the capability of LLMs for KGQA.
title Ontology-Guided Reverse Thinking Makes Large Language Models Stronger on Knowledge Graph Question Answering
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2502.11491