RAS: Retrieval-And-Structuring for Knowledge-Intensive LLM Generation
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866918312225538048 |
|---|---|
| author | Jiang, Pengcheng Cao, Lang Zhu, Ruike Jiang, Minhao Zhang, Yunyi Shen, Jiaming Sun, Jimeng Han, Jiawei |
| author_facet | Jiang, Pengcheng Cao, Lang Zhu, Ruike Jiang, Minhao Zhang, Yunyi Shen, Jiaming Sun, Jimeng Han, Jiawei |
| contents | Large language models (LLMs) have achieved impressive performance on knowledge-intensive tasks, yet they often struggle with multi-step reasoning due to the unstructured nature of retrieved context. While retrieval-augmented generation (RAG) methods provide external information, the lack of explicit organization among retrieved passages limits their effectiveness, leading to brittle reasoning pathways. Recent interpretability studies highlighting the importance of structured intermediate reasoning further align with this perspective. We propose Retrieval-And-Structuring (RAS), a framework that dynamically constructs question-specific knowledge graphs through iterative retrieval and structured knowledge building. RAS interleaves targeted retrieval planning with incremental graph construction, enabling models to assemble and reason over evolving knowledge structures tailored to each query. On seven knowledge-intensive benchmarks, RAS consistently outperforms strong baselines, achieving up to 8.7\% and 7.0\% gains with proprietary and open-source LLMs, respectively. Our results demonstrate that dynamic, question-specific knowledge structuring offers a robust path to improving reasoning accuracy and robustness in language model generation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_10996 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | RAS: Retrieval-And-Structuring for Knowledge-Intensive LLM Generation Jiang, Pengcheng Cao, Lang Zhu, Ruike Jiang, Minhao Zhang, Yunyi Shen, Jiaming Sun, Jimeng Han, Jiawei Computation and Language Large language models (LLMs) have achieved impressive performance on knowledge-intensive tasks, yet they often struggle with multi-step reasoning due to the unstructured nature of retrieved context. While retrieval-augmented generation (RAG) methods provide external information, the lack of explicit organization among retrieved passages limits their effectiveness, leading to brittle reasoning pathways. Recent interpretability studies highlighting the importance of structured intermediate reasoning further align with this perspective. We propose Retrieval-And-Structuring (RAS), a framework that dynamically constructs question-specific knowledge graphs through iterative retrieval and structured knowledge building. RAS interleaves targeted retrieval planning with incremental graph construction, enabling models to assemble and reason over evolving knowledge structures tailored to each query. On seven knowledge-intensive benchmarks, RAS consistently outperforms strong baselines, achieving up to 8.7\% and 7.0\% gains with proprietary and open-source LLMs, respectively. Our results demonstrate that dynamic, question-specific knowledge structuring offers a robust path to improving reasoning accuracy and robustness in language model generation. |
| title | RAS: Retrieval-And-Structuring for Knowledge-Intensive LLM Generation |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2502.10996 |