Visual Reasoning Tracer: Object-Level Grounded Reasoning Benchmark
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866918232064000000 |
|---|---|
| author | Yuan, Haobo Sun, Yueyi Li, Yanwei Zhang, Tao Deng, Xueqing Ding, Henghui Qi, Lu Wang, Anran Li, Xiangtai Yang, Ming-Hsuan |
| author_facet | Yuan, Haobo Sun, Yueyi Li, Yanwei Zhang, Tao Deng, Xueqing Ding, Henghui Qi, Lu Wang, Anran Li, Xiangtai Yang, Ming-Hsuan |
| contents | Recent advances in Multimodal Large Language Models (MLLMs) have significantly improved performance on tasks such as visual grounding and visual question answering. However, the reasoning processes of these models remain largely opaque; they typically output only final predictions without revealing the intermediate steps or fine-grained evidence (e.g., pixels, locations) that lead to the result. This contrasts with human intelligence, which naturally operates through a chain of visual reasoning. To address this limitation, we introduce the Visual Reasoning Tracer (VRT) task, which requires models to not only localize the target object but also explicitly predict the intermediate objects that form the reasoning path. To advance research in this area, we contribute: (1) VRT-Bench, a human-annotated benchmark for evaluating visual reasoning; (2) a new metric for assessing the quality of reasoning traces; and (3) VRT-80k, a large-scale dataset for reasoning model training. Our experiments reveal that while existing models often produce the correct final output, they struggle to ground their intermediate reasoning. In contrast, models trained on VRT-80k achieve substantial improvements in tracing the reasoning path. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2512_05091 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Visual Reasoning Tracer: Object-Level Grounded Reasoning Benchmark Yuan, Haobo Sun, Yueyi Li, Yanwei Zhang, Tao Deng, Xueqing Ding, Henghui Qi, Lu Wang, Anran Li, Xiangtai Yang, Ming-Hsuan Computer Vision and Pattern Recognition Recent advances in Multimodal Large Language Models (MLLMs) have significantly improved performance on tasks such as visual grounding and visual question answering. However, the reasoning processes of these models remain largely opaque; they typically output only final predictions without revealing the intermediate steps or fine-grained evidence (e.g., pixels, locations) that lead to the result. This contrasts with human intelligence, which naturally operates through a chain of visual reasoning. To address this limitation, we introduce the Visual Reasoning Tracer (VRT) task, which requires models to not only localize the target object but also explicitly predict the intermediate objects that form the reasoning path. To advance research in this area, we contribute: (1) VRT-Bench, a human-annotated benchmark for evaluating visual reasoning; (2) a new metric for assessing the quality of reasoning traces; and (3) VRT-80k, a large-scale dataset for reasoning model training. Our experiments reveal that while existing models often produce the correct final output, they struggle to ground their intermediate reasoning. In contrast, models trained on VRT-80k achieve substantial improvements in tracing the reasoning path. |
| title | Visual Reasoning Tracer: Object-Level Grounded Reasoning Benchmark |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2512.05091 |