AutoSearch: Adaptive Search Depth for Efficient Agentic RAG via Reinforcement Learning
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866911605601599488 |
|---|---|
| author | Sun, Jingbo Chong, Wenyue Tu, Songjun Zhang, Qichao Zhang, Yaocheng Chai, Jiajun Wang, Xiaohan Lin, Wei Yin, Guojun Zhao, Dongbin |
| author_facet | Sun, Jingbo Chong, Wenyue Tu, Songjun Zhang, Qichao Zhang, Yaocheng Chai, Jiajun Wang, Xiaohan Lin, Wei Yin, Guojun Zhao, Dongbin |
| contents | Agentic retrieval-augmented generation (RAG) systems enable large language models (LLMs) to solve complex tasks through multi-step interaction with external retrieval tools. However, such multi-step interaction often involves redundant search steps, incurring substantial computational cost and latency. Prior work limits search depth (i.e., the number of search steps) to reduce cost, but this often leads to underexploration of complex questions. To address this, we first investigate how search depth affects accuracy and find a minimal sufficient search depth that defines an accuracy-efficiency trade-off, jointly determined by question complexity and the agent's capability. Furthermore, we propose AutoSearch, a reinforcement learning (RL) framework that evaluates each search step via self-generated intermediate answers. By a self-answering mechanism, AutoSearch identifies the minimal sufficient search depth and promotes efficient search by rewarding its attainment while penalizing over-searching. In addition, reward mechanisms are introduced to stabilize search behavior and improve answer quality on complex questions. Extensive experiments on multiple benchmarks show that AutoSearch achieves a superior accuracy-efficiency trade-off, alleviating over-searching while preserving search quality. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_17337 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | AutoSearch: Adaptive Search Depth for Efficient Agentic RAG via Reinforcement Learning Sun, Jingbo Chong, Wenyue Tu, Songjun Zhang, Qichao Zhang, Yaocheng Chai, Jiajun Wang, Xiaohan Lin, Wei Yin, Guojun Zhao, Dongbin Artificial Intelligence Agentic retrieval-augmented generation (RAG) systems enable large language models (LLMs) to solve complex tasks through multi-step interaction with external retrieval tools. However, such multi-step interaction often involves redundant search steps, incurring substantial computational cost and latency. Prior work limits search depth (i.e., the number of search steps) to reduce cost, but this often leads to underexploration of complex questions. To address this, we first investigate how search depth affects accuracy and find a minimal sufficient search depth that defines an accuracy-efficiency trade-off, jointly determined by question complexity and the agent's capability. Furthermore, we propose AutoSearch, a reinforcement learning (RL) framework that evaluates each search step via self-generated intermediate answers. By a self-answering mechanism, AutoSearch identifies the minimal sufficient search depth and promotes efficient search by rewarding its attainment while penalizing over-searching. In addition, reward mechanisms are introduced to stabilize search behavior and improve answer quality on complex questions. Extensive experiments on multiple benchmarks show that AutoSearch achieves a superior accuracy-efficiency trade-off, alleviating over-searching while preserving search quality. |
| title | AutoSearch: Adaptive Search Depth for Efficient Agentic RAG via Reinforcement Learning |
| topic | Artificial Intelligence |
| url | https://arxiv.org/abs/2604.17337 |