Copertina

CSVQA: A Chinese Multimodal Benchmark for Evaluating STEM Reasoning Capabilities of VLMs

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Jian, Ai, Qiu, Weijie, Wang, Xiaokun, Wang, Peiyu, Hao, Yunzhuo, Pei, Jiangbo, Wei, Yichen, Peng, Yi, Song, Xuchen
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computer Vision and Pattern Recognition Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Skywork-VL Reward: An Effective Reward Model for Multimodal Understanding and Reasoning
di: Wang, Xiaokun, et al.
Pubblicazione: (2025)

Skywork R1V2: Multimodal Hybrid Reinforcement Learning for Reasoning
di: Wang, Peiyu, et al.
Pubblicazione: (2025)

Skywork R1V: Pioneering Multimodal Reasoning with Chain-of-Thought
di: Peng, Yi, et al.
Pubblicazione: (2025)

Skywork-R1V3 Technical Report
di: Shen, Wei, et al.
Pubblicazione: (2025)

Skywork-R1V4: Toward Agentic Multimodal Intelligence through Interleaved Thinking with Images and DeepResearch
di: Zhang, Yifan, et al.
Pubblicazione: (2025)

Can MLLMs Reason in Multimodality? EMMA: An Enhanced MultiModal ReAsoning Benchmark
di: Hao, Yunzhuo, et al.
Pubblicazione: (2025)

STEMVerse: A Dual-Axis Diagnostic Framework for STEM Reasoning in Large Language Models
di: Li, Xuzhao, et al.
Pubblicazione: (2026)

GAOKAO-MM: A Chinese Human-Level Benchmark for Multimodal Models Evaluation
di: Zong, Yi, et al.
Pubblicazione: (2024)

DeepPHY: Benchmarking Agentic VLMs on Physical Reasoning
di: Xu, Xinrun, et al.
Pubblicazione: (2025)

VisRes Bench: On Evaluating the Visual Reasoning Capabilities of VLMs
di: Törtei, Brigitta Malagurski, et al.
Pubblicazione: (2025)

Skywork UniPic: Unified Autoregressive Modeling for Visual Understanding and Generation
di: Wang, Peiyu, et al.
Pubblicazione: (2025)

Unveiling Fine-Grained Visual Traces: Evaluating Multimodal Interleaved Reasoning Chains in Multimodal STEM Tasks
di: Jin, Jing, et al.
Pubblicazione: (2026)

The Gordian Knot for VLMs: Diagrammatic Knot Reasoning as a Hard Benchmark
di: Liu, Hao, et al.
Pubblicazione: (2026)

SUPERChem: A Multimodal Reasoning Benchmark in Chemistry
di: Zhao, Zehua, et al.
Pubblicazione: (2025)

Chart-based Reasoning: Transferring Capabilities from LLMs to VLMs
di: Carbune, Victor, et al.
Pubblicazione: (2024)

ElectriQ: A Benchmark for Assessing the Response Capability of Large Language Models in Power Marketing
di: Wang, Jinzhi, et al.
Pubblicazione: (2025)

ThinkMorph: Emergent Properties in Multimodal Interleaved Chain-of-Thought Reasoning
di: Gu, Jiawei, et al.
Pubblicazione: (2025)

SID: Benchmarking Guided Instruction Capabilities in STEM Education with a Socratic Interdisciplinary Dialogues Dataset
di: Jiang, Mei, et al.
Pubblicazione: (2025)

MMAFFBen: A Multilingual and Multimodal Affective Analysis Benchmark for Evaluating LLMs and VLMs
di: Liu, Zhiwei, et al.
Pubblicazione: (2025)

VerifyBench: A Systematic Benchmark for Evaluating Reasoning Verifiers Across Domains
di: Li, Xuzhao, et al.
Pubblicazione: (2025)

TCC-Bench: Benchmarking the Traditional Chinese Culture Understanding Capabilities of MLLMs
di: Xu, Pengju, et al.
Pubblicazione: (2025)

STEM: Efficient Relative Capability Evaluation of LLMs through Structured Transition Samples
di: Hu, Haiquan, et al.
Pubblicazione: (2025)

Multimodal Needle in a Haystack: Benchmarking Long-Context Capability of Multimodal Large Language Models
di: Wang, Hengyi, et al.
Pubblicazione: (2024)

MPBench: A Comprehensive Multimodal Reasoning Benchmark for Process Errors Identification
di: Xu, Zhaopan, et al.
Pubblicazione: (2025)

CHBench: A Cognitive Hierarchy Benchmark for Evaluating Strategic Reasoning Capability of LLMs
di: Liu, Hongtao, et al.
Pubblicazione: (2025)

Design Principles for the Construction of a Benchmark Evaluating Security Operation Capabilities of Multi-agent AI Systems
di: Cai, Yicheng, et al.
Pubblicazione: (2026)

TReB: A Comprehensive Benchmark for Evaluating Table Reasoning Capabilities of Large Language Models
di: Li, Ce, et al.
Pubblicazione: (2025)

ECG-Reasoning-Benchmark: A Benchmark for Evaluating Clinical Reasoning Capabilities in ECG Interpretation
di: Oh, Jungwoo, et al.
Pubblicazione: (2026)

Benchmarking VLMs' Reasoning About Persuasive Atypical Images
di: Malakouti, Sina, et al.
Pubblicazione: (2024)

VRIQ: Benchmarking and Analyzing Visual-Reasoning IQ of VLMs
di: Khezresmaeilzadeh, Tina, et al.
Pubblicazione: (2026)

Evaluating MLLMs with Multimodal Multi-image Reasoning Benchmark
di: Cheng, Ziming, et al.
Pubblicazione: (2025)

Retrieval-Infused Reasoning Sandbox: A Benchmark for Decoupling Retrieval and Reasoning Capabilities
di: Ying, Shuangshuang, et al.
Pubblicazione: (2026)

VLMs have Tunnel Vision: Evaluating Nonlocal Visual Reasoning in Leading VLMs
di: Berman, Shmuel, et al.
Pubblicazione: (2025)

SubstationAI: Multimodal Large Model-Based Approaches for Analyzing Substation Equipment Faults
di: Wang, Jinzhi, et al.
Pubblicazione: (2024)

A Benchmark for Audio Reasoning Capabilities of Multimodal Large Language Models
di: Christop, Iwona, et al.
Pubblicazione: (2026)

AMSbench: A Comprehensive Benchmark for Evaluating MLLM Capabilities in AMS Circuits
di: Shi, Yichen, et al.
Pubblicazione: (2025)

MDK12-Bench: A Multi-Discipline Benchmark for Evaluating Reasoning in Multimodal Large Language Models
di: Zhou, Pengfei, et al.
Pubblicazione: (2025)

Visual Language Tracking with Multi-modal Interaction: A Robust Benchmark
di: Li, Xuchen, et al.
Pubblicazione: (2024)

Capabilities of GPT-5 on Multimodal Medical Reasoning
di: Wang, Shansong, et al.
Pubblicazione: (2025)

MMLU-SR: A Benchmark for Stress-Testing Reasoning Capability of Large Language Models
di: Wang, Wentian, et al.
Pubblicazione: (2024)