KG-Retriever: Efficient Knowledge Indexing for Retrieval-Augmented Large Language Models

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Chen, Weijie, Bai, Ting, Su, Jinbo, Luan, Jian, Liu, Wei, Shi, Chuan
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866908348380610560
author Chen, Weijie
Bai, Ting
Su, Jinbo
Luan, Jian
Liu, Wei
Shi, Chuan
author_facet Chen, Weijie
Bai, Ting
Su, Jinbo
Luan, Jian
Liu, Wei
Shi, Chuan
contents Large language models with retrieval-augmented generation encounter a pivotal challenge in intricate retrieval tasks, e.g., multi-hop question answering, which requires the model to navigate across multiple documents and generate comprehensive responses based on fragmented information. To tackle this challenge, we introduce a novel Knowledge Graph-based RAG framework with a hierarchical knowledge retriever, termed KG-Retriever. The retrieval indexing in KG-Retriever is constructed on a hierarchical index graph that consists of a knowledge graph layer and a collaborative document layer. The associative nature of graph structures is fully utilized to strengthen intra-document and inter-document connectivity, thereby fundamentally alleviating the information fragmentation problem and meanwhile improving the retrieval efficiency in cross-document retrieval of LLMs. With the coarse-grained collaborative information from neighboring documents and concise information from the knowledge graph, KG-Retriever achieves marked improvements on five public QA datasets, showing the effectiveness and efficiency of our proposed RAG framework.
format Preprint
id arxiv_https___arxiv_org_abs_2412_05547
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle KG-Retriever: Efficient Knowledge Indexing for Retrieval-Augmented Large Language Models
Chen, Weijie
Bai, Ting
Su, Jinbo
Luan, Jian
Liu, Wei
Shi, Chuan
Information Retrieval
Artificial Intelligence
Large language models with retrieval-augmented generation encounter a pivotal challenge in intricate retrieval tasks, e.g., multi-hop question answering, which requires the model to navigate across multiple documents and generate comprehensive responses based on fragmented information. To tackle this challenge, we introduce a novel Knowledge Graph-based RAG framework with a hierarchical knowledge retriever, termed KG-Retriever. The retrieval indexing in KG-Retriever is constructed on a hierarchical index graph that consists of a knowledge graph layer and a collaborative document layer. The associative nature of graph structures is fully utilized to strengthen intra-document and inter-document connectivity, thereby fundamentally alleviating the information fragmentation problem and meanwhile improving the retrieval efficiency in cross-document retrieval of LLMs. With the coarse-grained collaborative information from neighboring documents and concise information from the knowledge graph, KG-Retriever achieves marked improvements on five public QA datasets, showing the effectiveness and efficiency of our proposed RAG framework.
title KG-Retriever: Efficient Knowledge Indexing for Retrieval-Augmented Large Language Models
topic Information Retrieval
Artificial Intelligence
url https://arxiv.org/abs/2412.05547