Doc-V*:Coarse-to-Fine Interactive Visual Reasoning for Multi-Page Document VQA
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2026
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866908966268698624 |
|---|---|
| author | Zheng, Yuanlei Fu, Pei Li, Hang Wang, Ziyang Zhang, Yuyi Ruan, Wenyu Zhang, Xiaojin Wei, Zhongyu Luo, Zhenbo Luan, Jian Chen, Wei Bai, Xiang |
| author_facet | Zheng, Yuanlei Fu, Pei Li, Hang Wang, Ziyang Zhang, Yuyi Ruan, Wenyu Zhang, Xiaojin Wei, Zhongyu Luo, Zhenbo Luan, Jian Chen, Wei Bai, Xiang |
| contents | Multi-page Document Visual Question Answering requires reasoning over semantics, layouts, and visual elements in long, visually dense documents. Existing OCR-free methods face a trade-off between capacity and precision: end-to-end models scale poorly with document length, while visual retrieval-based pipelines are brittle and passive. We propose Doc-$V^*$, an \textbf{OCR-free agentic} framework that casts multi-page DocVQA as sequential evidence aggregation. Doc-$V^*$ begins with a thumbnail overview, then actively navigates via semantic retrieval and targeted page fetching, and aggregates evidence in a structured working memory for grounded reasoning. Trained by imitation learning from expert trajectories and further optimized with Group Relative Policy Optimization, Doc-$V^*$ balances answer accuracy with evidence-seeking efficiency. Across five benchmarks, Doc-$V^*$ outperforms open-source baselines and approaches proprietary models, improving out-of-domain performance by up to \textbf{47.9\%} over RAG baseline. Other results reveal effective evidence aggregation with selective attention, not increased input pages. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_13731 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Doc-V*:Coarse-to-Fine Interactive Visual Reasoning for Multi-Page Document VQA Zheng, Yuanlei Fu, Pei Li, Hang Wang, Ziyang Zhang, Yuyi Ruan, Wenyu Zhang, Xiaojin Wei, Zhongyu Luo, Zhenbo Luan, Jian Chen, Wei Bai, Xiang Computation and Language Multi-page Document Visual Question Answering requires reasoning over semantics, layouts, and visual elements in long, visually dense documents. Existing OCR-free methods face a trade-off between capacity and precision: end-to-end models scale poorly with document length, while visual retrieval-based pipelines are brittle and passive. We propose Doc-$V^*$, an \textbf{OCR-free agentic} framework that casts multi-page DocVQA as sequential evidence aggregation. Doc-$V^*$ begins with a thumbnail overview, then actively navigates via semantic retrieval and targeted page fetching, and aggregates evidence in a structured working memory for grounded reasoning. Trained by imitation learning from expert trajectories and further optimized with Group Relative Policy Optimization, Doc-$V^*$ balances answer accuracy with evidence-seeking efficiency. Across five benchmarks, Doc-$V^*$ outperforms open-source baselines and approaches proprietary models, improving out-of-domain performance by up to \textbf{47.9\%} over RAG baseline. Other results reveal effective evidence aggregation with selective attention, not increased input pages. |
| title | Doc-V*:Coarse-to-Fine Interactive Visual Reasoning for Multi-Page Document VQA |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2604.13731 |