Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2505.18105 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866908376576819200 |
|---|---|
| author | Huang, Lisheng Liu, Yichen Jiang, Jinhao Zhang, Rongxiang Yan, Jiahao Li, Junyi Zhao, Wayne Xin |
| author_facet | Huang, Lisheng Liu, Yichen Jiang, Jinhao Zhang, Rongxiang Yan, Jiahao Li, Junyi Zhao, Wayne Xin |
| contents | Recent advances in web-augmented large language models (LLMs) have exhibited strong performance in complex reasoning tasks, yet these capabilities are mostly locked in proprietary systems with opaque architectures. In this work, we propose \textbf{ManuSearch}, a transparent and modular multi-agent framework designed to democratize deep search for LLMs. ManuSearch decomposes the search and reasoning process into three collaborative agents: (1) a solution planning agent that iteratively formulates sub-queries, (2) an Internet search agent that retrieves relevant documents via real-time web search, and (3) a structured webpage reading agent that extracts key evidence from raw web content. To rigorously evaluate deep reasoning abilities, we introduce \textbf{ORION}, a challenging benchmark focused on open-web reasoning over long-tail entities, covering both English and Chinese. Experimental results show that ManuSearch substantially outperforms prior open-source baselines and even surpasses leading closed-source systems. Our work paves the way for reproducible, extensible research in open deep search systems. We release the data and code in https://github.com/RUCAIBox/ManuSearch |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_18105 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | ManuSearch: Democratizing Deep Search in Large Language Models with a Transparent and Open Multi-Agent Framework Huang, Lisheng Liu, Yichen Jiang, Jinhao Zhang, Rongxiang Yan, Jiahao Li, Junyi Zhao, Wayne Xin Computation and Language Recent advances in web-augmented large language models (LLMs) have exhibited strong performance in complex reasoning tasks, yet these capabilities are mostly locked in proprietary systems with opaque architectures. In this work, we propose \textbf{ManuSearch}, a transparent and modular multi-agent framework designed to democratize deep search for LLMs. ManuSearch decomposes the search and reasoning process into three collaborative agents: (1) a solution planning agent that iteratively formulates sub-queries, (2) an Internet search agent that retrieves relevant documents via real-time web search, and (3) a structured webpage reading agent that extracts key evidence from raw web content. To rigorously evaluate deep reasoning abilities, we introduce \textbf{ORION}, a challenging benchmark focused on open-web reasoning over long-tail entities, covering both English and Chinese. Experimental results show that ManuSearch substantially outperforms prior open-source baselines and even surpasses leading closed-source systems. Our work paves the way for reproducible, extensible research in open deep search systems. We release the data and code in https://github.com/RUCAIBox/ManuSearch |
| title | ManuSearch: Democratizing Deep Search in Large Language Models with a Transparent and Open Multi-Agent Framework |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2505.18105 |