Image de couverture de livre

Traveling Across Languages: Benchmarking Cross-Lingual Consistency in Multimodal LLMs

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Wang, Hao, Huang, Pinzhi, Yang, Jihan, Xie, Saining, Kawahara, Daisuke
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language Artificial Intelligence Computer Vision and Pattern Recognition Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

MULTITEXTEDIT: Benchmarking Cross-Lingual Degradation in Text-in-Image Editing
par: Cheng, Liwei, et autres
Publié: (2026)

V-IRL: Grounding Virtual Intelligence in Real Life
par: Yang, Jihan, et autres
Publié: (2024)

CLAIM: Mitigating Multilingual Object Hallucination in Large Vision-Language Models with Cross-Lingual Attention Intervention
par: Ye, Zekai, et autres
Publié: (2025)

A Survey on Benchmarks of Multimodal Large Language Models
par: Li, Jian, et autres
Publié: (2024)

Med-UniC: Unifying Cross-Lingual Medical Vision-Language Pre-Training by Diminishing Bias
par: Wan, Zhongwei, et autres
Publié: (2023)

INDOTABVQA: A Benchmark for Cross-Lingual Table Understanding in Bahasa Indonesia Documents
par: Gautam, Somraj, et autres
Publié: (2026)

Can't See the Forest for the Trees: Benchmarking Multimodal Safety Awareness for Multimodal LLMs
par: Wang, Wenxuan, et autres
Publié: (2025)

Analyzing Reasoning Consistency in Large Multimodal Models under Cross-Modal Conflicts
par: Zhu, Zhihao, et autres
Publié: (2026)

MLLM-CompBench: A Comparative Reasoning Benchmark for Multimodal LLMs
par: Kil, Jihyung, et autres
Publié: (2024)

Unlearning Sensitive Information in Multimodal LLMs: Benchmark and Attack-Defense Evaluation
par: Patil, Vaidehi, et autres
Publié: (2025)

Can Multimodal LLMs See Materials Clearly? A Multimodal Benchmark on Materials Characterization
par: Lai, Zhengzhao, et autres
Publié: (2025)

Evaluating Multimodal Large Language Models on Vertically Written Japanese Text
par: Sasagawa, Keito, et autres
Publié: (2025)

Multimodal LLMs Struggle with Basic Visual Network Analysis: a VNA Benchmark
par: Williams, Evan M., et autres
Publié: (2024)

Sparse Autoencoders as Plug-and-Play Firewalls for Adversarial Attack Detection in VLMs
par: Wang, Hao, et autres
Publié: (2026)

Benchmarking Multimodal Large Language Models for Face Recognition
par: Shahreza, Hatef Otroshi, et autres
Publié: (2025)

A Multimodal Recaptioning Framework to Account for Perceptual Diversity Across Languages in Vision-Language Modeling
par: Buettner, Kyle, et autres
Publié: (2025)

VIR-Bench: Evaluating Geospatial and Temporal Understanding of MLLMs via Travel Video Itinerary Reconstruction
par: Wang, Hao, et autres
Publié: (2025)

Mind the (Language) Gap: Towards Probing Numerical and Cross-Lingual Limits of LVLMs
par: Gautam, Somraj, et autres
Publié: (2025)

II-Bench: An Image Implication Understanding Benchmark for Multimodal Large Language Models
par: Liu, Ziqiang, et autres
Publié: (2024)

TP-Eval: Tap Multimodal LLMs' Potential in Evaluation by Customizing Prompts
par: Xie, Yuxuan, et autres
Publié: (2024)

Cross-modal Information Flow in Multimodal Large Language Models
par: Zhang, Zhi, et autres
Publié: (2024)

Cross-Modal Projection in Multimodal LLMs Doesn't Really Project Visual Attributes to Textual Space
par: Verma, Gaurav, et autres
Publié: (2024)

Flattery in Motion: Benchmarking and Analyzing Sycophancy in Video-LLMs
par: Zhou, Wenrui, et autres
Publié: (2025)

HSSBench: Benchmarking Humanities and Social Sciences Ability for Multimodal Large Language Models
par: Kang, Zhaolu, et autres
Publié: (2025)

The BLA Benchmark: Investigating Basic Language Abilities of Pre-Trained Multimodal Models
par: Chen, Xinyi, et autres
Publié: (2023)

MMMG: a Comprehensive and Reliable Evaluation Suite for Multitask Multimodal Generation
par: Yao, Jihan, et autres
Publié: (2025)

VinaBench: Benchmark for Faithful and Consistent Visual Narratives
par: Gao, Silin, et autres
Publié: (2025)

MM-BrowseComp: A Comprehensive Benchmark for Multimodal Browsing Agents
par: Li, Shilong, et autres
Publié: (2025)

CrossWordBench: Evaluating the Reasoning Capabilities of LLMs and LVLMs with Controllable Puzzle Generation
par: Leng, Jixuan, et autres
Publié: (2025)

Benchmarking Egocentric Clinical Intent Understanding Capability for Medical Multimodal Large Language Models
par: Liu, Shaonan, et autres
Publié: (2026)

MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmark
par: Chen, Dongping, et autres
Publié: (2024)

A Survey on Evaluation of Multimodal Large Language Models
par: Huang, Jiaxing, et autres
Publié: (2024)

Detecting and Mitigating Hateful Content in Multimodal Memes with Vision-Language Models
par: Van, Minh-Hao, et autres
Publié: (2025)

Model Composition for Multimodal Large Language Models
par: Chen, Chi, et autres
Publié: (2024)

Vision Enhancing LLMs: Empowering Multimodal Knowledge Storage and Sharing in LLMs
par: Li, Yunxin, et autres
Publié: (2023)

Cross-Modal Adapter for Vision-Language Retrieval
par: Jiang, Haojun, et autres
Publié: (2022)

Med-RewardBench: Benchmarking Reward Models and Judges for Medical Multimodal Large Language Models
par: Ding, Meidan, et autres
Publié: (2025)

Multimodal Needle in a Haystack: Benchmarking Long-Context Capability of Multimodal Large Language Models
par: Wang, Hengyi, et autres
Publié: (2024)

Humor in Pixels: Benchmarking Large Multimodal Models Understanding of Online Comics
par: Ryan, Yuriel, et autres
Publié: (2025)

Scientific Reasoning: Assessment of Multimodal Generative LLMs
par: Dreyer, Florian, et autres
Publié: (2025)