RAG+: Enhancing Retrieval-Augmented Generation with Application-Aware Reasoning

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Wang, Yu, Zhao, Shiwan, Wang, Zhihu, Fan, Ming, Zhang, Xicheng, Zhang, Yubo, Wang, Zhengfan, Huang, Heyuan, Liu, Ting
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911170750840832
author Wang, Yu
Zhao, Shiwan
Wang, Zhihu
Fan, Ming
Zhang, Xicheng
Zhang, Yubo
Wang, Zhengfan
Huang, Heyuan
Liu, Ting
author_facet Wang, Yu
Zhao, Shiwan
Wang, Zhihu
Fan, Ming
Zhang, Xicheng
Zhang, Yubo
Wang, Zhengfan
Huang, Heyuan
Liu, Ting
contents The integration of external knowledge through Retrieval-Augmented Generation (RAG) has become foundational in enhancing large language models (LLMs) for knowledge-intensive tasks. However, existing RAG paradigms often overlook the cognitive step of applying knowledge, leaving a gap between retrieved facts and task-specific reasoning. In this work, we introduce RAG+, a principled and modular extension that explicitly incorporates application-aware reasoning into the RAG pipeline. RAG+ constructs a dual corpus consisting of knowledge and aligned application examples, created either manually or automatically, and retrieves both jointly during inference. This design enables LLMs not only to access relevant information but also to apply it within structured, goal-oriented reasoning processes. Experiments across mathematical, legal, and medical domains, conducted on multiple models, demonstrate that RAG+ consistently outperforms standard RAG variants, achieving average improvements of 3-5%, and peak gains up to 13.5% in complex scenarios. By bridging retrieval with actionable application, RAG+ advances a more cognitively grounded framework for knowledge integration, representing a step toward more interpretable and capable LLMs.
format Preprint
id arxiv_https___arxiv_org_abs_2506_11555
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle RAG+: Enhancing Retrieval-Augmented Generation with Application-Aware Reasoning
Wang, Yu
Zhao, Shiwan
Wang, Zhihu
Fan, Ming
Zhang, Xicheng
Zhang, Yubo
Wang, Zhengfan
Huang, Heyuan
Liu, Ting
Artificial Intelligence
Computation and Language
The integration of external knowledge through Retrieval-Augmented Generation (RAG) has become foundational in enhancing large language models (LLMs) for knowledge-intensive tasks. However, existing RAG paradigms often overlook the cognitive step of applying knowledge, leaving a gap between retrieved facts and task-specific reasoning. In this work, we introduce RAG+, a principled and modular extension that explicitly incorporates application-aware reasoning into the RAG pipeline. RAG+ constructs a dual corpus consisting of knowledge and aligned application examples, created either manually or automatically, and retrieves both jointly during inference. This design enables LLMs not only to access relevant information but also to apply it within structured, goal-oriented reasoning processes. Experiments across mathematical, legal, and medical domains, conducted on multiple models, demonstrate that RAG+ consistently outperforms standard RAG variants, achieving average improvements of 3-5%, and peak gains up to 13.5% in complex scenarios. By bridging retrieval with actionable application, RAG+ advances a more cognitively grounded framework for knowledge integration, representing a step toward more interpretable and capable LLMs.
title RAG+: Enhancing Retrieval-Augmented Generation with Application-Aware Reasoning
topic Artificial Intelligence
Computation and Language
url https://arxiv.org/abs/2506.11555