Image de couverture de livre

EXAMS-V: A Multi-Discipline Multilingual Multimodal Exam Benchmark for Evaluating Vision Language Models

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Das, Rocktim Jyoti, Hristov, Simeon Emilov, Li, Haonan, Dimitrov, Dimitar Iliyanov, Koychev, Ivan, Nakov, Preslav
Format:	Preprint
Publié:	2024
Sujets:	Computation and Language Computer Vision and Pattern Recognition
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

FMI_SU_Yotkova_Kastreva at SemEval-2026 Task 13: Lightweight Detection of LLM-Generated Code via Stylometric Signals
par: Yotkova, Elitsa, et autres
Publié: (2026)

Post-OCR Text Correction for Bulgarian Historical Documents
par: Beshirov, Angel, et autres
Publié: (2024)

The CLEF-2026 FinMMEval Lab: Multilingual and Multimodal Evaluation of Financial AI Systems
par: Xie, Zhuohan, et autres
Publié: (2026)

MALMM: Multi-Agent Large Language Models for Zero-Shot Robotics Manipulation
par: Singh, Harsh, et autres
Publié: (2024)

Detecting Check-Worthy Claims in Political Debates, Speeches, and Interviews Using Audio Data
par: Ivanov, Petar, et autres
Publié: (2023)

Factuality of Large Language Models: A Survey
par: Wang, Yuxia, et autres
Publié: (2024)

SLAT-Phys: Fast Material Property Field Prediction from Structured 3D Latents
par: Das, Rocktim Jyoti, et autres
Publié: (2026)

MemeLens: Multilingual Multitask VLMs for Memes
par: Shahroor, Ali Ezzat, et autres
Publié: (2026)

DUAL-Bench: Measuring Over-Refusal and Robustness in Vision-Language Models
par: Ren, Kaixuan, et autres
Publié: (2025)

CoDet-M4: Detecting Machine-Generated Code in Multi-Lingual, Multi-Generator and Multi-Domain Settings
par: Orel, Daniil, et autres
Publié: (2025)

Kaleidoscope: In-language Exams for Massively Multilingual Vision Evaluation
par: Salazar, Israfel, et autres
Publié: (2025)

Using LLMs for Multilingual Clinical Entity Linking to ICD-10
par: Vassileva, Sylvia, et autres
Publié: (2025)

Synergizing In-context Learning with Hints for End-to-end Task-oriented Dialog Systems
par: Saley, Vishal Vivek, et autres
Publié: (2024)

MemeMQA: Multimodal Question Answering for Memes via Rationale-Based Inferencing
par: Agarwal, Siddhant, et autres
Publié: (2024)

From Generation to Detection: A Multimodal Multi-Task Dataset for Benchmarking Health Misinformation
par: Zhang, Zhihao, et autres
Publié: (2025)

Beyond Size: How Gradients Shape Pruning Decisions in Large Language Models
par: Das, Rocktim Jyoti, et autres
Publié: (2023)

MediTOD: An English Dialogue Dataset for Medical History Taking with Comprehensive Annotations
par: Saley, Vishal Vivek, et autres
Publié: (2024)

Multimodal Large Language Models to Support Real-World Fact-Checking
par: Geng, Jiahui, et autres
Publié: (2024)

EuraGovExam: A Multilingual Multimodal Benchmark from Real-World Civil Service Exams
par: Kim, Jaeseong, et autres
Publié: (2026)

MuDRiC: Multi-Dialect Reasoning for Arabic Commonsense Validation
par: Elozeiri, Kareem, et autres
Publié: (2025)

Large Language Models are Few-Shot Training Example Generators: A Case Study in Fallacy Recognition
par: Alhindi, Tariq, et autres
Publié: (2023)

Rethinking STS and NLI in Large Language Models
par: Wang, Yuxia, et autres
Publié: (2023)

Can Machines Resonate with Humans? Evaluating the Emotional and Empathic Comprehension of LMs
par: Manzoor, Muhammad Arslan, et autres
Publié: (2024)

Arabic Dataset for LLM Safeguard Evaluation
par: Ashraf, Yasser, et autres
Publié: (2024)

AVMeme Exam: A Multimodal Multilingual Multicultural Benchmark for LLMs' Contextual and Cultural Knowledge and Thinking
par: Jiang, Xilin, et autres
Publié: (2026)

From Chaos to Clarity: Claim Normalization to Empower Fact-Checking
par: Sundriyal, Megha, et autres
Publié: (2023)

Adapting Fake News Detection to the Era of Large Language Models
par: Su, Jinyan, et autres
Publié: (2023)

OpenFactCheck: Building, Benchmarking Customized Fact-Checking Systems and Evaluating the Factuality of Claims and LLMs
par: Wang, Yuxia, et autres
Publié: (2024)

Not All Proofs Are Equal: Evaluating LLM Proof Quality Beyond Correctness
par: Petrov, Ivo, et autres
Publié: (2026)

Toxicity Red-Teaming: Benchmarking LLM Safety in Singapore's Low-Resource Languages
par: Hu, Yujia, et autres
Publié: (2025)

HALF: Harm-Aware LLM Fairness Evaluation Aligned with Deployment
par: Mekky, Ali, et autres
Publié: (2025)

UnsafeChain: Enhancing Reasoning Model Safety via Hard Cases
par: Tomar, Raj Vardhan, et autres
Publié: (2025)

How Does Prefix Matter in Reasoning Model Tuning?
par: Tomar, Raj Vardhan, et autres
Publié: (2026)

Con Instruction: Universal Jailbreaking of Multimodal Large Language Models via Non-Textual Modalities
par: Geng, Jiahui, et autres
Publié: (2025)

FMI@SU ToxHabits: Evaluating LLMs Performance on Toxic Habit Extraction in Spanish Clinical Texts
par: Vassileva, Sylvia, et autres
Publié: (2026)

BLAZER: Bootstrapping LLM-based Manipulation Agents with Zero-Shot Data Generation
par: Das, Rocktim Jyoti, et autres
Publié: (2025)

A Chinese Dataset for Evaluating the Safeguards in Large Language Models
par: Wang, Yuxia, et autres
Publié: (2024)

DialectalArabicMMLU: Benchmarking Dialectal Capabilities in Arabic and Multilingual Language Models
par: Altakrori, Malik H., et autres
Publié: (2025)

ConspirED: A Dataset for Cognitive Traits of Conspiracy Theories and Large Language Model Safety
par: Bates, Luke, et autres
Publié: (2025)

UNCERTAINTY-LINE: Length-Invariant Estimation of Uncertainty for Large Language Models
par: Vashurin, Roman, et autres
Publié: (2025)