Efficient Federated Search for Retrieval-Augmented Generation using Lightweight Routing
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866911577609863168 |
|---|---|
| author | Dhasade, Akash Guerraoui, Rachid Kermarrec, Anne-Marie Petrescu, Diana Pires, Rafael Randl, Mathis de Vos, Martijn |
| author_facet | Dhasade, Akash Guerraoui, Rachid Kermarrec, Anne-Marie Petrescu, Diana Pires, Rafael Randl, Mathis de Vos, Martijn |
| contents | Large language models (LLMs) achieve remarkable performance across domains but remain prone to hallucinations and inconsistencies. Retrieval-augmented generation (RAG) mitigates these issues by augmenting model inputs with relevant documents retrieved from external sources. In many real-world scenarios, relevant knowledge is fragmented across organizations or institutions, motivating the need for federated search mechanisms that can aggregate results from heterogeneous data sources without centralizing the data. We introduce RAGRoute, a lightweight routing mechanism for federated search in RAG systems that dynamically selects relevant data sources at query time using a neural classifier, avoiding indiscriminate querying. This selective routing reduces communication overhead and end-to-end latency while preserving retrieval quality, achieving up to 80.65% reductions in communication volume and 52.50% reductions in latency across three benchmarks, while matching the accuracy of querying all sources. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_19280 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Efficient Federated Search for Retrieval-Augmented Generation using Lightweight Routing Dhasade, Akash Guerraoui, Rachid Kermarrec, Anne-Marie Petrescu, Diana Pires, Rafael Randl, Mathis de Vos, Martijn Machine Learning Distributed, Parallel, and Cluster Computing Information Retrieval Large language models (LLMs) achieve remarkable performance across domains but remain prone to hallucinations and inconsistencies. Retrieval-augmented generation (RAG) mitigates these issues by augmenting model inputs with relevant documents retrieved from external sources. In many real-world scenarios, relevant knowledge is fragmented across organizations or institutions, motivating the need for federated search mechanisms that can aggregate results from heterogeneous data sources without centralizing the data. We introduce RAGRoute, a lightweight routing mechanism for federated search in RAG systems that dynamically selects relevant data sources at query time using a neural classifier, avoiding indiscriminate querying. This selective routing reduces communication overhead and end-to-end latency while preserving retrieval quality, achieving up to 80.65% reductions in communication volume and 52.50% reductions in latency across three benchmarks, while matching the accuracy of querying all sources. |
| title | Efficient Federated Search for Retrieval-Augmented Generation using Lightweight Routing |
| topic | Machine Learning Distributed, Parallel, and Cluster Computing Information Retrieval |
| url | https://arxiv.org/abs/2502.19280 |