Seek-and-Solve: Benchmarking MLLMs for Visual Clue-Driven Reasoning in Daily Scenarios

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Li, Xiaomin, Wang, Tala, Zhong, Zichen, Zhang, Ying, Zheng, Zirui, Isobe, Takashi, Li, Dezhuang, Lu, Huchuan, He, You, Jia, Xu
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908969562275840
author Li, Xiaomin
Wang, Tala
Zhong, Zichen
Zhang, Ying
Zheng, Zirui
Isobe, Takashi
Li, Dezhuang
Lu, Huchuan
He, You
Jia, Xu
author_facet Li, Xiaomin
Wang, Tala
Zhong, Zichen
Zhang, Ying
Zheng, Zirui
Isobe, Takashi
Li, Dezhuang
Lu, Huchuan
He, You
Jia, Xu
contents Daily scenarios are characterized by visual richness, requiring Multimodal Large Language Models (MLLMs) to filter noise and identify decisive visual clues for accurate reasoning. Yet, current benchmarks predominantly aim at evaluating MLLMs' pre-existing knowledge or perceptual understanding, often neglecting the critical capability of reasoning. To bridge this gap, we introduce DailyClue, a benchmark designed for visual clue-driven reasoning in daily scenarios. Our construction is guided by two core principles: (1) strict grounding in authentic daily activities, and (2) challenging query design that necessitates more than surface-level perception. Instead of simple recognition, our questions compel MLLMs to actively explore suitable visual clues and leverage them for subsequent reasoning. To this end, we curate a comprehensive dataset spanning four major daily domains and 16 distinct subtasks. Comprehensive evaluation across MLLMs and agentic models underscores the formidable challenge posed by our benchmark. Our analysis reveals several critical insights, emphasizing that the accurate identification of visual clues is essential for robust reasoning.
format Preprint
id arxiv_https___arxiv_org_abs_2604_14041
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Seek-and-Solve: Benchmarking MLLMs for Visual Clue-Driven Reasoning in Daily Scenarios
Li, Xiaomin
Wang, Tala
Zhong, Zichen
Zhang, Ying
Zheng, Zirui
Isobe, Takashi
Li, Dezhuang
Lu, Huchuan
He, You
Jia, Xu
Computer Vision and Pattern Recognition
Daily scenarios are characterized by visual richness, requiring Multimodal Large Language Models (MLLMs) to filter noise and identify decisive visual clues for accurate reasoning. Yet, current benchmarks predominantly aim at evaluating MLLMs' pre-existing knowledge or perceptual understanding, often neglecting the critical capability of reasoning. To bridge this gap, we introduce DailyClue, a benchmark designed for visual clue-driven reasoning in daily scenarios. Our construction is guided by two core principles: (1) strict grounding in authentic daily activities, and (2) challenging query design that necessitates more than surface-level perception. Instead of simple recognition, our questions compel MLLMs to actively explore suitable visual clues and leverage them for subsequent reasoning. To this end, we curate a comprehensive dataset spanning four major daily domains and 16 distinct subtasks. Comprehensive evaluation across MLLMs and agentic models underscores the formidable challenge posed by our benchmark. Our analysis reveals several critical insights, emphasizing that the accurate identification of visual clues is essential for robust reasoning.
title Seek-and-Solve: Benchmarking MLLMs for Visual Clue-Driven Reasoning in Daily Scenarios
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2604.14041