Cover Image

TreePS-RAG: Tree-based Process Supervision for Reinforcement Learning in Agentic RAG

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhang, Tianhua, Li, Kun, Li, Junan, Li, Yunxiang, Luo, Hongyin, Wu, Xixin, Glass, James, Meng, Helen
Format:	Preprint
Published:	2026
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

RAG-Zeval: Towards Robust and Interpretable Evaluation on RAG Responses through End-to-End Rule-Guided Reasoning
by: Li, Kun, et al.
Published: (2025)

Adaptive Query Rewriting: Aligning Rewriters through Marginal Probability of Conversational Answers
by: Zhang, Tianhua, et al.
Published: (2024)

Decoding on Graphs: Faithful and Sound Reasoning on Knowledge Graphs through Generation of Well-Formed Chains
by: Li, Kun, et al.
Published: (2024)

Generate, Discriminate, Evolve: Enhancing Context Faithfulness via Fine-Grained Sentence-Level Self-Evolution
by: Li, Kun, et al.
Published: (2025)

Devising a Set of Compact and Explainable Spoken Language Feature for Screening Alzheimer's Disease
by: Li, Junan, et al.
Published: (2024)

Natural Language Embedded Programs for Hybrid Language Symbolic Reasoning
by: Zhang, Tianhua, et al.
Published: (2023)

Not All Errors Are Equal: Investigation of Speech Recognition Errors in Alzheimer's Disease Detection
by: Kang, Jiawen, et al.
Published: (2024)

Purple-teaming LLMs with Adversarial Defender Training
by: Zhou, Jingyan, et al.
Published: (2024)

Towards Agentic RAG with Deep Reasoning: A Survey of RAG-Reasoning Systems in LLMs
by: Li, Yangning, et al.
Published: (2025)

Rethinking Machine Ethics -- Can LLMs Perform Moral Reasoning through the Lens of Moral Theories?
by: Zhou, Jingyan, et al.
Published: (2023)

ProRAG: Process-Supervised Reinforcement Learning for Retrieval-Augmented Generation
by: Wang, Zhao, et al.
Published: (2026)

RQ-RAG: Learning to Refine Queries for Retrieval Augmented Generation
by: Chan, Chi-Min, et al.
Published: (2024)

MMSU: A Massive Multi-task Spoken Language Understanding and Reasoning Benchmark
by: Wang, Dingdong, et al.
Published: (2025)

Agentic Cognitive Profiling: Realigning Automated Alzheimer's Disease Detection with Clinical Construct Validity
by: Kang, Jiawen, et al.
Published: (2026)

SIRAG: Towards Stable and Interpretable RAG with A Process-Supervised Multi-Agent Framework
by: Wang, Junlin, et al.
Published: (2025)

DecEx-RAG: Boosting Agentic Retrieval-Augmented Generation with Decision and Execution Optimization via Process Supervision
by: Leng, Yongqi, et al.
Published: (2025)

Is Agentic RAG worth it? An experimental comparison of RAG approaches
by: Ferrazzi, Pietro, et al.
Published: (2026)

Seamless Language Expansion: Enhancing Multilingual Mastery in Self-Supervised Models
by: Xu, Jing, et al.
Published: (2024)

THREAD: Thinking Deeper with Recursive Spawning
by: Schroeder, Philip, et al.
Published: (2024)

Does RAG Really Perform Bad For Long-Context Processing?
by: Luo, Kun, et al.
Published: (2025)

Efficient and Transferable Agentic Knowledge Graph RAG via Reinforcement Learning
by: Lin, Junhong, et al.
Published: (2025)

Graph-R1: Towards Agentic GraphRAG Framework via End-to-end Reinforcement Learning
by: Luo, Haoran, et al.
Published: (2025)

Relevance to Utility: Process-Supervised Rewrite for RAG
by: Kim, Jaeyoung, et al.
Published: (2025)

DeepRAG: Integrating Hierarchical Reasoning and Process Supervision for Biomedical Multi-Hop QA
by: Ji, Yuelyu, et al.
Published: (2025)

Advancing Multi-Agent RAG Systems with Minimalist Reinforcement Learning
by: Wu, Yihong, et al.
Published: (2025)

Discovery and Reinforcement of Tool-Integrated Reasoning Chains via Rollout Trees
by: Li, Kun, et al.
Published: (2026)

RAGShaper: Eliciting Sophisticated Agentic RAG Skills via Automated Data Synthesis
by: Tao, Zhengwei, et al.
Published: (2026)

LatentRAG: Latent Reasoning and Retrieval for Efficient Agentic RAG
by: Zheng, Yijia, et al.
Published: (2026)

From RAG to Agentic RAG for Faithful Islamic Question Answering
by: Bhatia, Gagan, et al.
Published: (2026)

Reward-RAG: Enhancing RAG with Reward Driven Supervision
by: Nguyen, Thang, et al.
Published: (2024)

R3-RAG: Learning Step-by-Step Reasoning and Retrieval for LLMs via Reinforcement Learning
by: Li, Yuan, et al.
Published: (2025)

SmartRAG: Jointly Learn RAG-Related Tasks From the Environment Feedback
by: Gao, Jingsheng, et al.
Published: (2024)

MiLorE-SSL: Scaling Multilingual Capabilities in Self-Supervised Models without Forgetting
by: Xu, Jing, et al.
Published: (2026)

UR$^2$: Unify RAG and Reasoning through Reinforcement Learning
by: Li, Weitao, et al.
Published: (2025)

EmoRAG: Evaluating RAG Robustness to Symbolic Perturbations
by: Zhou, Xinyun, et al.
Published: (2025)

End-to-End Agentic RAG System Training for Traceable Diagnostic Reasoning
by: Zheng, Qiaoyu, et al.
Published: (2025)

Injecting linguistic knowledge into BERT for Dialogue State Tracking
by: Feng, Xiaohan, et al.
Published: (2023)

Process vs. Outcome Reward: Which is Better for Agentic RAG Reinforcement Learning
by: Zhang, Wenlin, et al.
Published: (2025)

BioRAG: A RAG-LLM Framework for Biological Question Reasoning
by: Wang, Chengrui, et al.
Published: (2024)

Optimizing Retrieval for RAG via Reinforcement Learning
by: Zhou, Jiawei, et al.
Published: (2025)