Retrieval-Augmented Generation for Large Language Models: A Survey

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Gao, Yunfan, Xiong, Yun, Gao, Xinyu, Jia, Kangxiang, Pan, Jinliu, Bi, Yuxi, Dai, Yi, Sun, Jiawei, Wang, Meng, Wang, Haofen
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910385431379968
author Gao, Yunfan
Xiong, Yun
Gao, Xinyu
Jia, Kangxiang
Pan, Jinliu
Bi, Yuxi
Dai, Yi
Sun, Jiawei
Wang, Meng
Wang, Haofen
author_facet Gao, Yunfan
Xiong, Yun
Gao, Xinyu
Jia, Kangxiang
Pan, Jinliu
Bi, Yuxi
Dai, Yi
Sun, Jiawei
Wang, Meng
Wang, Haofen
contents Large Language Models (LLMs) showcase impressive capabilities but encounter challenges like hallucination, outdated knowledge, and non-transparent, untraceable reasoning processes. Retrieval-Augmented Generation (RAG) has emerged as a promising solution by incorporating knowledge from external databases. This enhances the accuracy and credibility of the generation, particularly for knowledge-intensive tasks, and allows for continuous knowledge updates and integration of domain-specific information. RAG synergistically merges LLMs' intrinsic knowledge with the vast, dynamic repositories of external databases. This comprehensive review paper offers a detailed examination of the progression of RAG paradigms, encompassing the Naive RAG, the Advanced RAG, and the Modular RAG. It meticulously scrutinizes the tripartite foundation of RAG frameworks, which includes the retrieval, the generation and the augmentation techniques. The paper highlights the state-of-the-art technologies embedded in each of these critical components, providing a profound understanding of the advancements in RAG systems. Furthermore, this paper introduces up-to-date evaluation framework and benchmark. At the end, this article delineates the challenges currently faced and points out prospective avenues for research and development.
format Preprint
id arxiv_https___arxiv_org_abs_2312_10997
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Retrieval-Augmented Generation for Large Language Models: A Survey
Gao, Yunfan
Xiong, Yun
Gao, Xinyu
Jia, Kangxiang
Pan, Jinliu
Bi, Yuxi
Dai, Yi
Sun, Jiawei
Wang, Meng
Wang, Haofen
Computation and Language
Artificial Intelligence
Large Language Models (LLMs) showcase impressive capabilities but encounter challenges like hallucination, outdated knowledge, and non-transparent, untraceable reasoning processes. Retrieval-Augmented Generation (RAG) has emerged as a promising solution by incorporating knowledge from external databases. This enhances the accuracy and credibility of the generation, particularly for knowledge-intensive tasks, and allows for continuous knowledge updates and integration of domain-specific information. RAG synergistically merges LLMs' intrinsic knowledge with the vast, dynamic repositories of external databases. This comprehensive review paper offers a detailed examination of the progression of RAG paradigms, encompassing the Naive RAG, the Advanced RAG, and the Modular RAG. It meticulously scrutinizes the tripartite foundation of RAG frameworks, which includes the retrieval, the generation and the augmentation techniques. The paper highlights the state-of-the-art technologies embedded in each of these critical components, providing a profound understanding of the advancements in RAG systems. Furthermore, this paper introduces up-to-date evaluation framework and benchmark. At the end, this article delineates the challenges currently faced and points out prospective avenues for research and development.
title Retrieval-Augmented Generation for Large Language Models: A Survey
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2312.10997