Image de couverture de livre

mmJEE-Eval: A Bilingual Multimodal Benchmark for Evaluating Scientific Reasoning in Vision-Language Models

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Mukherjee, Arka, Ghosh, Shreya
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Toward Socially Aware Vision-Language Models: Evaluating Cultural Competence Through Multimodal Story Generation
par: Mukherjee, Arka, et autres
Publié: (2025)

RoleEval: A Bilingual Role Evaluation Benchmark for Large Language Models
par: Shen, Tianhao, et autres
Publié: (2023)

SciEval: A Multi-Level Large Language Model Evaluation Benchmark for Scientific Research
par: Sun, Liangtai, et autres
Publié: (2023)

IndicEval: A Bilingual Indian Educational Evaluation Framework for Large Language Models
par: Bharti, Saurabh, et autres
Publié: (2026)

LC-Eval: A Bilingual Multi-Task Evaluation Benchmark for Long-Context Understanding
par: Jubair, Sheikh, et autres
Publié: (2025)

EnigmaEval: A Benchmark of Long Multimodal Reasoning Challenges
par: Wang, Clinton J., et autres
Publié: (2025)

UNITE-FND: Reframing Multimodal Fake News Detection through Unimodal Scene Translation
par: Mukherjee, Arka, et autres
Publié: (2025)

OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problems
par: He, Chaoqun, et autres
Publié: (2024)

ArxEval: Evaluating Retrieval and Generation in Language Models for Scientific Literature
par: Sinha, Aarush, et autres
Publié: (2025)

SciKnowEval: Evaluating Multi-level Scientific Knowledge of Large Language Models
par: Feng, Kehua, et autres
Publié: (2024)

DivLogicEval: A Framework for Benchmarking Logical Reasoning Evaluation in Large Language Models
par: Chung, Tsz Ting, et autres
Publié: (2025)

Coherent Multimodal Reasoning with Iterative Self-Evaluation for Vision-Language Models
par: Luo, Wenjie, et autres
Publié: (2025)

ScholarBench: A Bilingual Benchmark for Abstraction, Comprehension, and Reasoning Evaluation in Academic Contexts
par: Noh, Dongwon, et autres
Publié: (2025)

LexEval: A Comprehensive Chinese Legal Benchmark for Evaluating Large Language Models
par: Li, Haitao, et autres
Publié: (2024)

MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Models
par: Kwan, Wai-Chung, et autres
Publié: (2024)

CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Models
par: Qiu, Zexuan, et autres
Publié: (2024)

PerHalluEval: Persian Hallucination Evaluation Benchmark for Large Language Models
par: Hosseini, Mohammad, et autres
Publié: (2025)

CodeApex: A Bilingual Programming Evaluation Benchmark for Large Language Models
par: Fu, Lingyue, et autres
Publié: (2023)

IPEval: A Bilingual Intellectual Property Agency Consultation Evaluation Benchmark for Large Language Models
par: Wang, Qiyao, et autres
Publié: (2024)

MastermindEval: A Simple But Scalable Reasoning Benchmark
par: Golde, Jonas, et autres
Publié: (2025)

StressEval: Failure-Driven Dynamic Benchmarking for Knowledge-Intensive Reasoning in Large Language Models
par: Chen, Yongrui, et autres
Publié: (2026)

CMoralEval: A Moral Evaluation Benchmark for Chinese Large Language Models
par: Yu, Linhao, et autres
Publié: (2024)

Golden Touchstone: A Comprehensive Bilingual Benchmark for Evaluating Financial Large Language Models
par: Wu, Xiaojun, et autres
Publié: (2024)

FinEval: A Chinese Financial Domain Knowledge Evaluation Benchmark for Large Language Models
par: Guo, Xin, et autres
Publié: (2023)

mHumanEval -- A Multilingual Benchmark to Evaluate Large Language Models for Code Generation
par: Raihan, Nishat, et autres
Publié: (2024)

MET-Bench: Multimodal Entity Tracking for Evaluating the Limitations of Vision-Language and Reasoning Models
par: Cohen, Vanya, et autres
Publié: (2025)

SciSafeEval: A Comprehensive Benchmark for Safety Alignment of Large Language Models in Scientific Tasks
par: Li, Tianhao, et autres
Publié: (2024)

NPHardEval4V: Dynamic Evaluation of Large Vision-Language Models with Effects of Vision
par: Li, Xiang, et autres
Publié: (2024)

HellaSwag-Pro: A Large-Scale Bilingual Benchmark for Evaluating the Robustness of LLMs in Commonsense Reasoning
par: Li, Xiaoyuan, et autres
Publié: (2025)

ConceptMath: A Bilingual Concept-wise Benchmark for Measuring Mathematical Reasoning of Large Language Models
par: Wu, Yanan, et autres
Publié: (2024)

Evaluating Reasoning Faithfulness in Medical Vision-Language Models using Multimodal Perturbations
par: Moll, Johannes, et autres
Publié: (2025)

CRiskEval: A Chinese Multi-Level Risk Evaluation Benchmark Dataset for Large Language Models
par: Shi, Ling, et autres
Publié: (2024)

FinEval-KR: A Financial Domain Evaluation Framework for Large Language Models' Knowledge and Reasoning
par: Dou, Shaoyu, et autres
Publié: (2025)

Reward Design for Physical Reasoning in Vision-Language Models
par: Lilienthal, Derek, et autres
Publié: (2026)

NorEval: A Norwegian Language Understanding and Generation Evaluation Benchmark
par: Mikhailov, Vladislav, et autres
Publié: (2025)

StatEval: A Comprehensive Benchmark for Large Language Models in Statistics
par: Lu, Yuchen, et autres
Publié: (2025)

MAC: A Live Benchmark for Multimodal Large Language Models in Scientific Understanding
par: Jiang, Mohan, et autres
Publié: (2025)

HKCanto-Eval: A Benchmark for Evaluating Cantonese Language Understanding and Cultural Comprehension in LLMs
par: Cheng, Tsz Chung, et autres
Publié: (2025)

MSA at ImageCLEF 2025 Multimodal Reasoning: Multilingual Multimodal Reasoning With Ensemble Vision Language Models
par: Ahmed, Seif, et autres
Publié: (2025)

EduEval: A Hierarchical Cognitive Benchmark for Evaluating Large Language Models in Chinese Education
par: Ma, Guoqing, et autres
Publié: (2025)