WebWatcher: Breaking New Frontier of Vision-Language Deep Research Agent

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Geng, Xinyu, Xia, Peng, Zhang, Zhen, Wang, Xinyu, Wang, Qiuchen, Ding, Ruixue, Wang, Chenxi, Wu, Jialong, Zhao, Yida, Li, Kuan, Jiang, Yong, Xie, Pengjun, Huang, Fei, Zhou, Jingren
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866909762497544192
author Geng, Xinyu
Xia, Peng
Zhang, Zhen
Wang, Xinyu
Wang, Qiuchen
Ding, Ruixue
Wang, Chenxi
Wu, Jialong
Zhao, Yida
Li, Kuan
Jiang, Yong
Xie, Pengjun
Huang, Fei
Zhou, Jingren
author_facet Geng, Xinyu
Xia, Peng
Zhang, Zhen
Wang, Xinyu
Wang, Qiuchen
Ding, Ruixue
Wang, Chenxi
Wu, Jialong
Zhao, Yida
Li, Kuan
Jiang, Yong
Xie, Pengjun
Huang, Fei
Zhou, Jingren
contents Web agents such as Deep Research have demonstrated superhuman cognitive abilities, capable of solving highly challenging information-seeking problems. However, most research remains primarily text-centric, overlooking visual information in the real world. This makes multimodal Deep Research highly challenging, as such agents require much stronger reasoning abilities in perception, logic, knowledge, and the use of more sophisticated tools compared to text-based agents. To address this limitation, we introduce WebWatcher, a multi-modal Agent for Deep Research equipped with enhanced visual-language reasoning capabilities. It leverages high-quality synthetic multimodal trajectories for efficient cold start training, utilizes various tools for deep reasoning, and further enhances generalization through reinforcement learning. To better evaluate the capabilities of multimodal agents, we propose BrowseComp-VL, a benchmark with BrowseComp-style that requires complex information retrieval involving both visual and textual information. Experimental results show that WebWatcher significantly outperforms proprietary baseline, RAG workflow and open-source agents in four challenging VQA benchmarks, which paves the way for solving complex multimodal information-seeking tasks.
format Preprint
id arxiv_https___arxiv_org_abs_2508_05748
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle WebWatcher: Breaking New Frontier of Vision-Language Deep Research Agent
Geng, Xinyu
Xia, Peng
Zhang, Zhen
Wang, Xinyu
Wang, Qiuchen
Ding, Ruixue
Wang, Chenxi
Wu, Jialong
Zhao, Yida
Li, Kuan
Jiang, Yong
Xie, Pengjun
Huang, Fei
Zhou, Jingren
Information Retrieval
Web agents such as Deep Research have demonstrated superhuman cognitive abilities, capable of solving highly challenging information-seeking problems. However, most research remains primarily text-centric, overlooking visual information in the real world. This makes multimodal Deep Research highly challenging, as such agents require much stronger reasoning abilities in perception, logic, knowledge, and the use of more sophisticated tools compared to text-based agents. To address this limitation, we introduce WebWatcher, a multi-modal Agent for Deep Research equipped with enhanced visual-language reasoning capabilities. It leverages high-quality synthetic multimodal trajectories for efficient cold start training, utilizes various tools for deep reasoning, and further enhances generalization through reinforcement learning. To better evaluate the capabilities of multimodal agents, we propose BrowseComp-VL, a benchmark with BrowseComp-style that requires complex information retrieval involving both visual and textual information. Experimental results show that WebWatcher significantly outperforms proprietary baseline, RAG workflow and open-source agents in four challenging VQA benchmarks, which paves the way for solving complex multimodal information-seeking tasks.
title WebWatcher: Breaking New Frontier of Vision-Language Deep Research Agent
topic Information Retrieval
url https://arxiv.org/abs/2508.05748