A Pilot Empirical Study on When and How to Use Knowledge Graphs as Retrieval Augmented Generation
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866910949566316544 |
|---|---|
| author | Yuan, Xujie Liu, Yongxu Di, Shimin Wu, Shiwen Zheng, Libin Meng, Rui Chen, Lei Zhou, Xiaofang Yin, Jian |
| author_facet | Yuan, Xujie Liu, Yongxu Di, Shimin Wu, Shiwen Zheng, Libin Meng, Rui Chen, Lei Zhou, Xiaofang Yin, Jian |
| contents | The integration of Knowledge Graphs (KGs) into the Retrieval Augmented Generation (RAG) framework has attracted significant interest, with early studies showing promise in mitigating hallucinations and improving model accuracy. However, a systematic understanding and comparative analysis of the rapidly emerging KG-RAG methods are still lacking. This paper seeks to lay the foundation for systematically answering the question of when and how to use KG-RAG by analyzing their performance in various application scenarios associated with different technical configurations. After outlining the mind map using KG-RAG framework and summarizing its popular pipeline, we conduct a pilot empirical study of KG-RAG works to reimplement and evaluate 6 KG-RAG methods across 9 datasets in diverse domains and scenarios, analyzing the impact of 9 KG-RAG configurations in combination with 17 LLMs, and combining Metacognition with KG-RAG as a pilot attempt. Our results underscore the critical role of appropriate application conditions and optimal configurations of KG-RAG components. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_20854 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | A Pilot Empirical Study on When and How to Use Knowledge Graphs as Retrieval Augmented Generation Yuan, Xujie Liu, Yongxu Di, Shimin Wu, Shiwen Zheng, Libin Meng, Rui Chen, Lei Zhou, Xiaofang Yin, Jian Artificial Intelligence Computation and Language The integration of Knowledge Graphs (KGs) into the Retrieval Augmented Generation (RAG) framework has attracted significant interest, with early studies showing promise in mitigating hallucinations and improving model accuracy. However, a systematic understanding and comparative analysis of the rapidly emerging KG-RAG methods are still lacking. This paper seeks to lay the foundation for systematically answering the question of when and how to use KG-RAG by analyzing their performance in various application scenarios associated with different technical configurations. After outlining the mind map using KG-RAG framework and summarizing its popular pipeline, we conduct a pilot empirical study of KG-RAG works to reimplement and evaluate 6 KG-RAG methods across 9 datasets in diverse domains and scenarios, analyzing the impact of 9 KG-RAG configurations in combination with 17 LLMs, and combining Metacognition with KG-RAG as a pilot attempt. Our results underscore the critical role of appropriate application conditions and optimal configurations of KG-RAG components. |
| title | A Pilot Empirical Study on When and How to Use Knowledge Graphs as Retrieval Augmented Generation |
| topic | Artificial Intelligence Computation and Language |
| url | https://arxiv.org/abs/2502.20854 |