Stateful Evidence-Driven Retrieval-Augmented Generation with Iterative Reasoning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Dong, Qi, Lin, Ziheng, Ding, Ning
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914476594298880
author Dong, Qi
Lin, Ziheng
Ding, Ning
author_facet Dong, Qi
Lin, Ziheng
Ding, Ning
contents Retrieval-Augmented Generation (RAG) grounds Large Language Models (LLMs) in external knowledge but often suffers from flat context representations and stateless retrieval, leading to unstable performance. We propose Stateful Evidence-Driven RAG with Iterative Reasoning, a framework that models question answering as a progressive evidence accumulation process. Retrieved documents are converted into structured reasoning units with explicit relevance and confidence signals and maintained in a persistent evidence pool capturing both supportive and non-supportive information. The framework performs evidence-driven deficiency analysis to identify gaps and conflicts and iteratively refines queries to guide subsequent retrieval. This iterative reasoning process enables stable evidence aggregation and improves robustness to noisy retrieval. Experiments on multiple question answering benchmarks demonstrate consistent improvements over standard RAG and multi-step baselines, while effectively accumulating high-quality evidence and maintaining stable performance under substantial retrieval noise.
format Preprint
id arxiv_https___arxiv_org_abs_2604_14170
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Stateful Evidence-Driven Retrieval-Augmented Generation with Iterative Reasoning
Dong, Qi
Lin, Ziheng
Ding, Ning
Computation and Language
Artificial Intelligence
Retrieval-Augmented Generation (RAG) grounds Large Language Models (LLMs) in external knowledge but often suffers from flat context representations and stateless retrieval, leading to unstable performance. We propose Stateful Evidence-Driven RAG with Iterative Reasoning, a framework that models question answering as a progressive evidence accumulation process. Retrieved documents are converted into structured reasoning units with explicit relevance and confidence signals and maintained in a persistent evidence pool capturing both supportive and non-supportive information. The framework performs evidence-driven deficiency analysis to identify gaps and conflicts and iteratively refines queries to guide subsequent retrieval. This iterative reasoning process enables stable evidence aggregation and improves robustness to noisy retrieval. Experiments on multiple question answering benchmarks demonstrate consistent improvements over standard RAG and multi-step baselines, while effectively accumulating high-quality evidence and maintaining stable performance under substantial retrieval noise.
title Stateful Evidence-Driven Retrieval-Augmented Generation with Iterative Reasoning
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2604.14170