Finding What Matters: Anchoring Context Knowledge with Evolving Indices for Iterative Retrieval

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Wu, Mingyan, Liu, Zhenghao, Li, Xinze, Lan, Yuqing, Yan, Yukun, Wang, Shuo, Yang, Cheng, Yu, Minghe, Zeng, Zheni, Sun, Maosong
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866916069794381824
author Wu, Mingyan
Liu, Zhenghao
Li, Xinze
Lan, Yuqing
Yan, Yukun
Wang, Shuo
Yang, Cheng
Yu, Minghe
Zeng, Zheni
Sun, Maosong
author_facet Wu, Mingyan
Liu, Zhenghao
Li, Xinze
Lan, Yuqing
Yan, Yukun
Wang, Shuo
Yang, Cheng
Yu, Minghe
Zeng, Zheni
Sun, Maosong
contents Retrieval-Augmented Generation (RAG) has become a dominant paradigm for mitigating hallucinations in Large Language Models (LLMs) by incorporating external knowledge. However, existing RAG systems often struggle to effectively integrate and reason over key evidence scattered across noisy retrieved documents, particularly in multi-hop scenarios. In this paper, we propose KAIR, a Knowledge Anchoring framework for Iterative Retrieval that anchors knowledge within retrieved knowledge to guide LLMs to locate the key information. During iterative retrieval, KAIR progressively updates the knowledge index to anchor salient evidence from retrieved documents. The evolving index serves as a navigational anchoring index that enables the LLM to assess knowledge sufficiency and formulate subsequent retrieval queries. Finally, KAIR generates answers by jointly leveraging the retrieved documents and the finalized anchoring index. Experiments on four multi-hop question answering benchmarks demonstrate that KAIR consistently outperforms strong RAG baselines. Further analysis shows that KAIR effectively anchors key knowledge and alleviates the context noise during iterative retrieval, improving the LLM's ability to associate and reason over dispersed evidence across retrieved documents. All code and data are available at https://github.com/NEUIR/KAIR.
format Preprint
id arxiv_https___arxiv_org_abs_2601_16462
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Finding What Matters: Anchoring Context Knowledge with Evolving Indices for Iterative Retrieval
Wu, Mingyan
Liu, Zhenghao
Li, Xinze
Lan, Yuqing
Yan, Yukun
Wang, Shuo
Yang, Cheng
Yu, Minghe
Zeng, Zheni
Sun, Maosong
Computation and Language
Retrieval-Augmented Generation (RAG) has become a dominant paradigm for mitigating hallucinations in Large Language Models (LLMs) by incorporating external knowledge. However, existing RAG systems often struggle to effectively integrate and reason over key evidence scattered across noisy retrieved documents, particularly in multi-hop scenarios. In this paper, we propose KAIR, a Knowledge Anchoring framework for Iterative Retrieval that anchors knowledge within retrieved knowledge to guide LLMs to locate the key information. During iterative retrieval, KAIR progressively updates the knowledge index to anchor salient evidence from retrieved documents. The evolving index serves as a navigational anchoring index that enables the LLM to assess knowledge sufficiency and formulate subsequent retrieval queries. Finally, KAIR generates answers by jointly leveraging the retrieved documents and the finalized anchoring index. Experiments on four multi-hop question answering benchmarks demonstrate that KAIR consistently outperforms strong RAG baselines. Further analysis shows that KAIR effectively anchors key knowledge and alleviates the context noise during iterative retrieval, improving the LLM's ability to associate and reason over dispersed evidence across retrieved documents. All code and data are available at https://github.com/NEUIR/KAIR.
title Finding What Matters: Anchoring Context Knowledge with Evolving Indices for Iterative Retrieval
topic Computation and Language
url https://arxiv.org/abs/2601.16462