Adversarial Yet Cooperative: Multi-Perspective Reasoning in Retrieved-Augmented Language Models

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Xu, Can, Yan, Lingyong, Wu, Jiayi, Wang, Haosen, Wang, Shuaiqiang, Li, Yuchen, Huang, Jizhou, Yin, Dawei, Li, Xiang
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909985383907328
author Xu, Can
Yan, Lingyong
Wu, Jiayi
Wang, Haosen
Wang, Shuaiqiang
Li, Yuchen
Huang, Jizhou
Yin, Dawei
Li, Xiang
author_facet Xu, Can
Yan, Lingyong
Wu, Jiayi
Wang, Haosen
Wang, Shuaiqiang
Li, Yuchen
Huang, Jizhou
Yin, Dawei
Li, Xiang
contents Recent advances in synergizing large reasoning models (LRMs) with retrieval-augmented generation (RAG) have shown promising results, yet two critical challenges remain: (1) reasoning models typically operate from a single, unchallenged perspective, limiting their ability to conduct deep, self-correcting reasoning over external documents, and (2) existing training paradigms rely excessively on outcome-oriented rewards, which provide insufficient signal for shaping the complex, multi-step reasoning process. To address these issues, we propose an Reasoner-Verifier framework named Adversarial Reasoning RAG (ARR). The Reasoner and Verifier engage in reasoning on retrieved evidence and critiquing each other's logic while being guided by process-aware advantage that requires no external scoring model. This reward combines explicit observational signals with internal model uncertainty to jointly optimize reasoning fidelity and verification rigor. Experiments on multiple benchmarks demonstrate the effectiveness of our method.
format Preprint
id arxiv_https___arxiv_org_abs_2601_04651
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Adversarial Yet Cooperative: Multi-Perspective Reasoning in Retrieved-Augmented Language Models
Xu, Can
Yan, Lingyong
Wu, Jiayi
Wang, Haosen
Wang, Shuaiqiang
Li, Yuchen
Huang, Jizhou
Yin, Dawei
Li, Xiang
Artificial Intelligence
Information Retrieval
Multiagent Systems
Recent advances in synergizing large reasoning models (LRMs) with retrieval-augmented generation (RAG) have shown promising results, yet two critical challenges remain: (1) reasoning models typically operate from a single, unchallenged perspective, limiting their ability to conduct deep, self-correcting reasoning over external documents, and (2) existing training paradigms rely excessively on outcome-oriented rewards, which provide insufficient signal for shaping the complex, multi-step reasoning process. To address these issues, we propose an Reasoner-Verifier framework named Adversarial Reasoning RAG (ARR). The Reasoner and Verifier engage in reasoning on retrieved evidence and critiquing each other's logic while being guided by process-aware advantage that requires no external scoring model. This reward combines explicit observational signals with internal model uncertainty to jointly optimize reasoning fidelity and verification rigor. Experiments on multiple benchmarks demonstrate the effectiveness of our method.
title Adversarial Yet Cooperative: Multi-Perspective Reasoning in Retrieved-Augmented Language Models
topic Artificial Intelligence
Information Retrieval
Multiagent Systems
url https://arxiv.org/abs/2601.04651