Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2407.00361 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911938205712384 |
|---|---|
| author | Jain, Palak Soares, Livio Baldini Kwiatkowski, Tom |
| author_facet | Jain, Palak Soares, Livio Baldini Kwiatkowski, Tom |
| contents | We present RICHES, a novel approach that interleaves retrieval with sequence generation tasks. RICHES offers an alternative to conventional RAG systems by eliminating the need for separate retriever and generator. It retrieves documents by directly decoding their contents, constrained on the corpus. Unifying retrieval with generation allows us to adapt to diverse new tasks via prompting alone. RICHES can work with any Instruction-tuned model, without additional training. It provides attributed evidence, supports multi-hop retrievals and interleaves thoughts to plan on what to retrieve next, all within a single decoding pass of the LLM. We demonstrate the strong performance of RICHES across ODQA tasks including attributed and multi-hop QA. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_00361 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | From RAG to RICHES: Retrieval Interlaced with Sequence Generation Jain, Palak Soares, Livio Baldini Kwiatkowski, Tom Computation and Language Artificial Intelligence We present RICHES, a novel approach that interleaves retrieval with sequence generation tasks. RICHES offers an alternative to conventional RAG systems by eliminating the need for separate retriever and generator. It retrieves documents by directly decoding their contents, constrained on the corpus. Unifying retrieval with generation allows us to adapt to diverse new tasks via prompting alone. RICHES can work with any Instruction-tuned model, without additional training. It provides attributed evidence, supports multi-hop retrievals and interleaves thoughts to plan on what to retrieve next, all within a single decoding pass of the LLM. We demonstrate the strong performance of RICHES across ODQA tasks including attributed and multi-hop QA. |
| title | From RAG to RICHES: Retrieval Interlaced with Sequence Generation |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2407.00361 |