Image de couverture de livre

Dissecting Dissonance: Benchmarking Large Multimodal Models Against Self-Contradictory Instructions

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Gao, Jin, Gan, Lei, Li, Yuankai, Ye, Yixin, Wang, Dequan
Format:	Preprint
Publié:	2024
Sujets:	Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

MAC: A Live Benchmark for Multimodal Large Language Models in Scientific Understanding
par: Jiang, Mohan, et autres
Publié: (2025)

Aligned Agents, Biased Swarm: Measuring Bias Amplification in Multi-Agent Systems
par: Li, Keyu, et autres
Publié: (2026)

Lost in Translation: Latent Concept Misalignment in Text-to-Image Diffusion Models
par: Zhao, Juntu, et autres
Publié: (2024)

Red Teaming Language Models for Processing Contradictory Dialogues
par: Wen, Xiaofei, et autres
Publié: (2024)

Reconciling Contradictory Views on the Effectiveness of SFT in LLMs: An Interaction Perspective
par: Zhang, Junpeng, et autres
Publié: (2026)

Text as Images: Can Multimodal Large Language Models Follow Printed Instructions in Pixels?
par: Li, Xiujun, et autres
Publié: (2023)

Credit-Budgeted ICPC-Style Coding: When Agents Must Pay for Every Decision
par: Zhou, Lingfeng, et autres
Publié: (2026)

Blocks as Probes: Dissecting Categorization Ability of Large Multimodal Models
par: Fu, Bin, et autres
Publié: (2024)

SafeRBench: Dissecting the Reasoning Safety of Large Language Models
par: Gao, Xin, et autres
Publié: (2025)

AGENTIF: Benchmarking Instruction Following of Large Language Models in Agentic Scenarios
par: Qi, Yunjia, et autres
Publié: (2025)

Saying the Unsaid: Revealing the Hidden Language of Multimodal Systems Through Telephone Games
par: Zhao, Juntu, et autres
Publié: (2025)

YINYANG-ALIGN: Benchmarking Contradictory Objectives and Proposing Multi-Objective Optimization based DPO for Text-to-Image Alignment
par: Das, Amitava, et autres
Publié: (2025)

ICU-Bench:Benchmarking Continual Unlearning in Multimodal Large Language Models
par: Wang, Yuhang, et autres
Publié: (2026)

A Survey on Benchmarks of Multimodal Large Language Models
par: Li, Jian, et autres
Publié: (2024)

GODBench: A Benchmark for Multimodal Large Language Models in Video Comment Art
par: Lei, Yiming, et autres
Publié: (2025)

Robust Prompt Optimization for Large Language Models Against Distribution Shifts
par: Li, Moxin, et autres
Publié: (2023)

Deconstructing Instruction-Following: A New Benchmark for Granular Evaluation of Large Language Model Instruction Compliance Abilities
par: Purpura, Alberto, et autres
Publié: (2026)

Experiences from Benchmarking Vision-Language-Action Models for Robotic Manipulation
par: Zhang, Yihao, et autres
Publié: (2025)

White-box Multimodal Jailbreaks Against Large Vision-Language Models
par: Wang, Ruofan, et autres
Publié: (2024)

Intelligent Computing Social Modeling and Methodological Innovations in Political Science in the Era of Large Language Models
par: Wang, Zhenyu, et autres
Publié: (2024)

Spatial Reasoning in Multimodal Large Language Models: A Survey of Tasks, Benchmarks and Methods
par: Liu, Weichen, et autres
Publié: (2025)

SpatialBench: Benchmarking Multimodal Large Language Models for Spatial Cognition
par: Xu, Peiran, et autres
Publié: (2025)

CIF-Bench: A Chinese Instruction-Following Benchmark for Evaluating the Generalizability of Large Language Models
par: LI, Yizhi, et autres
Publié: (2024)

ChartM$^3$: Benchmarking Chart Editing with Multimodal Instructions
par: Yang, Donglu, et autres
Publié: (2025)

Benchmarking Multimodal Knowledge Conflict for Large Multimodal Models
par: Jia, Yifan, et autres
Publié: (2025)

ABC-Eval: Benchmarking Large Language Models on Symbolic Music Understanding and Instruction Following
par: Zhao, Jiahao, et autres
Publié: (2025)

Text Steganography with Dynamic Codebook and Multimodal Large Language Model
par: Gao, Jianxin, et autres
Publié: (2026)

Lost in the Hype: Revealing and Dissecting the Performance Degradation of Medical Multimodal Large Language Models in Image Classification
par: Zhu, Xun, et autres
Publié: (2026)

Defending Large Language Models Against Jailbreak Attacks via Layer-specific Editing
par: Zhao, Wei, et autres
Publié: (2024)

A Survey on Multimodal Benchmarks: In the Era of Large AI Models
par: Li, Lin, et autres
Publié: (2024)

Enterprise Large Language Model Evaluation Benchmark
par: Wang, Liya, et autres
Publié: (2025)

Image Generation from Contextually-Contradictory Prompts
par: Huberman, Saar, et autres
Publié: (2025)

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions
par: Larbi, Maya, et autres
Publié: (2025)

Towards Robust Instruction Tuning on Multimodal Large Language Models
par: Han, Wei, et autres
Publié: (2024)

Advancing Multimodal Large Language Models in Chart Question Answering with Visualization-Referenced Instruction Tuning
par: Zeng, Xingchen, et autres
Publié: (2024)

MMAD: A Comprehensive Benchmark for Multimodal Large Language Models in Industrial Anomaly Detection
par: Jiang, Xi, et autres
Publié: (2024)

Rationality Check! Benchmarking the Rationality of Large Language Models
par: Zhou, Zhilun, et autres
Publié: (2025)

DatasetResearch: Benchmarking Agent Systems for Demand-Driven Dataset Discovery
par: Li, Keyu, et autres
Publié: (2025)

A Novel Approach to for Multimodal Emotion Recognition : Multimodal semantic information fusion
par: Dai, Wei, et autres
Publié: (2025)

Now You Hear Me: Audio Narrative Attacks Against Large Audio-Language Models
par: Yu, Ye, et autres
Publié: (2026)