Memory-augmented Query Reconstruction for LLM-based Knowledge Graph Reasoning
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866913723551055872 |
|---|---|
| author | Xu, Mufan Liang, Gewen Chen, Kehai Wang, Wei Zhou, Xun Yang, Muyun Zhao, Tiejun Zhang, Min |
| author_facet | Xu, Mufan Liang, Gewen Chen, Kehai Wang, Wei Zhou, Xun Yang, Muyun Zhao, Tiejun Zhang, Min |
| contents | Large language models (LLMs) have achieved remarkable performance on knowledge graph question answering (KGQA) tasks by planning and interacting with knowledge graphs. However, existing methods often confuse tool utilization with knowledge reasoning, harming readability of model outputs and giving rise to hallucinatory tool invocations, which hinder the advancement of KGQA. To address this issue, we propose Memory-augmented Query Reconstruction for LLM-based Knowledge Graph Reasoning (MemQ) to decouple LLM from tool invocation tasks using LLM-built query memory. By establishing a memory module with explicit descriptions of query statements, the proposed MemQ facilitates the KGQA process with natural language reasoning and memory-augmented query reconstruction. Meanwhile, we design an effective and readable reasoning to enhance the LLM's reasoning capability in KGQA. Experimental results that MemQ achieves state-of-the-art performance on widely used benchmarks WebQSP and CWQ. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_05193 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Memory-augmented Query Reconstruction for LLM-based Knowledge Graph Reasoning Xu, Mufan Liang, Gewen Chen, Kehai Wang, Wei Zhou, Xun Yang, Muyun Zhao, Tiejun Zhang, Min Computation and Language Large language models (LLMs) have achieved remarkable performance on knowledge graph question answering (KGQA) tasks by planning and interacting with knowledge graphs. However, existing methods often confuse tool utilization with knowledge reasoning, harming readability of model outputs and giving rise to hallucinatory tool invocations, which hinder the advancement of KGQA. To address this issue, we propose Memory-augmented Query Reconstruction for LLM-based Knowledge Graph Reasoning (MemQ) to decouple LLM from tool invocation tasks using LLM-built query memory. By establishing a memory module with explicit descriptions of query statements, the proposed MemQ facilitates the KGQA process with natural language reasoning and memory-augmented query reconstruction. Meanwhile, we design an effective and readable reasoning to enhance the LLM's reasoning capability in KGQA. Experimental results that MemQ achieves state-of-the-art performance on widely used benchmarks WebQSP and CWQ. |
| title | Memory-augmented Query Reconstruction for LLM-based Knowledge Graph Reasoning |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2503.05193 |