Image de couverture de livre

Multi-Physics: A Comprehensive Benchmark for Multimodal LLMs Reasoning on Chinese Multi-Subject Physics Problems

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Luo, Zhongze, Yin, Zhenshuai, Guo, Yongxin, Wang, Zhichao, Zhu, Jionghao, Tang, Xiaoying
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Adaptive Prompt Structure Factorization: A Framework for Self-Discovering and Optimizing Compositional Prompt Programs
par: Liu, Haoyue, et autres
Publié: (2026)

KG2QA: Knowledge Graph-enhanced Retrieval-augmented Generation for Communication Standards Question Answering
par: Luo, Zhongze, et autres
Publié: (2025)

LawLuo: A Multi-Agent Collaborative Framework for Multi-Round Chinese Legal Consultation
par: Sun, Jingyun, et autres
Publié: (2024)

SuperCLUE-Math6: Graded Multi-Step Math Reasoning Benchmark for LLMs in Chinese
par: Xu, Liang, et autres
Publié: (2024)

CMMMU: A Chinese Massive Multi-discipline Multimodal Understanding Benchmark
par: Zhang, Ge, et autres
Publié: (2024)

MTCMB: A Multi-Task Benchmark Framework for Evaluating LLMs on Knowledge, Reasoning, and Safety in Traditional Chinese Medicine
par: Kong, Shufeng, et autres
Publié: (2025)

ABench-Physics: Benchmarking Physical Reasoning in LLMs via High-Difficulty and Dynamic Physics Problems
par: Zhang, Yiming, et autres
Publié: (2025)

TIME: A Multi-level Benchmark for Temporal Reasoning of LLMs in Real-World Scenarios
par: Wei, Shaohang, et autres
Publié: (2025)

C$^{3}$Bench: A Comprehensive Classical Chinese Understanding Benchmark for Large Language Models
par: Cao, Jiahuan, et autres
Publié: (2024)

Benchmarking Chinese Commonsense Reasoning with a Multi-hop Reasoning Perspective
par: You, Wangjie, et autres
Publié: (2025)

CMMU: A Benchmark for Chinese Multi-modal Multi-type Question Understanding and Reasoning
par: He, Zheqi, et autres
Publié: (2024)

AnesSuite: A Comprehensive Benchmark and Dataset Suite for Anesthesiology Reasoning in LLMs
par: Feng, Xiang, et autres
Publié: (2025)

MTR-Bench: A Comprehensive Benchmark for Multi-Turn Reasoning Evaluation
par: Li, Xiaoyuan, et autres
Publié: (2025)

Symbolic or Numerical? Understanding Physics Problem Solving in Reasoning LLMs
par: Dan, Nifu, et autres
Publié: (2025)

Benchmarking Chinese Commonsense Reasoning of LLMs: From Chinese-Specifics to Reasoning-Memorization Correlations
par: Sun, Jiaxing, et autres
Publié: (2024)

Advancing AI-Scientist Understanding: Multi-Agent LLMs with Interpretable Physics Reasoning
par: Xu, Yinggan, et autres
Publié: (2025)

LLMEval-Logic: A Solver-Verified Chinese Benchmark for Logical Reasoning of LLMs with Adversarial Hardening
par: Zhang, Ming, et autres
Publié: (2026)

Multi-IF: Benchmarking LLMs on Multi-Turn and Multilingual Instructions Following
par: He, Yun, et autres
Publié: (2024)

GeoEval: Benchmark for Evaluating LLMs and Multi-Modal Models on Geometry Problem-Solving
par: Zhang, Jiaxin, et autres
Publié: (2024)

InspireDebate: Multi-Dimensional Subjective-Objective Evaluation-Guided Reasoning and Optimization for Debating
par: Wang, Fuyu, et autres
Publié: (2025)

Multi-TW: Benchmarking Multimodal Models on Traditional Chinese Question Answering in Taiwan
par: Yao, Jui-Ming, et autres
Publié: (2025)

UGPhysics: A Comprehensive Benchmark for Undergraduate Physics Reasoning with Large Language Models
par: Xu, Xin, et autres
Publié: (2025)

PIDP-Attack: Combining Prompt Injection with Database Poisoning Attacks on Retrieval-Augmented Generation Systems
par: Wang, Haozhen, et autres
Publié: (2026)

MMSciBench: Benchmarking Language Models on Chinese Multimodal Scientific Problems
par: Ye, Xinwu, et autres
Publié: (2025)

CFBench: A Comprehensive Constraints-Following Benchmark for LLMs
par: Zhang, Tao, et autres
Publié: (2024)

CDTP: A Large-Scale Chinese Data-Text Pair Dataset for Comprehensive Evaluation of Chinese LLMs
par: Wu, Chengwei, et autres
Publié: (2025)

AgriEval: A Comprehensive Chinese Agricultural Benchmark for Large Language Models
par: Yan, Lian, et autres
Publié: (2025)

FinMME: Benchmark Dataset for Financial Multi-Modal Reasoning Evaluation
par: Luo, Junyu, et autres
Publié: (2025)

SciVerse: Unveiling the Knowledge Comprehension and Visual Reasoning of LMMs on Multi-modal Scientific Problems
par: Guo, Ziyu, et autres
Publié: (2025)

CFinBench: A Comprehensive Chinese Financial Benchmark for Large Language Models
par: Nie, Ying, et autres
Publié: (2024)

Difficult Task Yes but Simple Task No: Unveiling the Laziness in Multimodal LLMs
par: Zhao, Sihang, et autres
Publié: (2024)

Flames: Benchmarking Value Alignment of LLMs in Chinese
par: Huang, Kexin, et autres
Publié: (2023)

Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis
par: Fu, Chaoyou, et autres
Publié: (2024)

MultiTrust: A Comprehensive Benchmark Towards Trustworthy Multimodal Large Language Models
par: Zhang, Yichi, et autres
Publié: (2024)

CMB: A Comprehensive Medical Benchmark in Chinese
par: Wang, Xidong, et autres
Publié: (2023)

INSEva: A Comprehensive Chinese Benchmark for Large Language Models in Insurance
par: Chen, Shisong, et autres
Publié: (2025)

XCR-Bench: A Multi-Task Benchmark for Evaluating Cultural Reasoning in LLMs
par: Kabir, Mohsinul, et autres
Publié: (2026)

GSM-Plus: A Comprehensive Benchmark for Evaluating the Robustness of LLMs as Mathematical Problem Solvers
par: Li, Qintong, et autres
Publié: (2024)

TurnBench-MS: A Benchmark for Evaluating Multi-Turn, Multi-Step Reasoning in Large Language Models
par: Zhang, Yiran, et autres
Publié: (2025)

IV-Bench: A Benchmark for Image-Grounded Video Perception and Reasoning in Multimodal LLMs
par: Ma, David, et autres
Publié: (2025)