Copertina

Dissecting Dissonance: Benchmarking Large Multimodal Models Against Self-Contradictory Instructions

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Gao, Jin, Gan, Lei, Li, Yuankai, Ye, Yixin, Wang, Dequan
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

MAC: A Live Benchmark for Multimodal Large Language Models in Scientific Understanding
di: Jiang, Mohan, et al.
Pubblicazione: (2025)

Aligned Agents, Biased Swarm: Measuring Bias Amplification in Multi-Agent Systems
di: Li, Keyu, et al.
Pubblicazione: (2026)

Lost in Translation: Latent Concept Misalignment in Text-to-Image Diffusion Models
di: Zhao, Juntu, et al.
Pubblicazione: (2024)

Red Teaming Language Models for Processing Contradictory Dialogues
di: Wen, Xiaofei, et al.
Pubblicazione: (2024)

Reconciling Contradictory Views on the Effectiveness of SFT in LLMs: An Interaction Perspective
di: Zhang, Junpeng, et al.
Pubblicazione: (2026)

Text as Images: Can Multimodal Large Language Models Follow Printed Instructions in Pixels?
di: Li, Xiujun, et al.
Pubblicazione: (2023)

Credit-Budgeted ICPC-Style Coding: When Agents Must Pay for Every Decision
di: Zhou, Lingfeng, et al.
Pubblicazione: (2026)

Blocks as Probes: Dissecting Categorization Ability of Large Multimodal Models
di: Fu, Bin, et al.
Pubblicazione: (2024)

SafeRBench: Dissecting the Reasoning Safety of Large Language Models
di: Gao, Xin, et al.
Pubblicazione: (2025)

AGENTIF: Benchmarking Instruction Following of Large Language Models in Agentic Scenarios
di: Qi, Yunjia, et al.
Pubblicazione: (2025)

Saying the Unsaid: Revealing the Hidden Language of Multimodal Systems Through Telephone Games
di: Zhao, Juntu, et al.
Pubblicazione: (2025)

YINYANG-ALIGN: Benchmarking Contradictory Objectives and Proposing Multi-Objective Optimization based DPO for Text-to-Image Alignment
di: Das, Amitava, et al.
Pubblicazione: (2025)

ICU-Bench:Benchmarking Continual Unlearning in Multimodal Large Language Models
di: Wang, Yuhang, et al.
Pubblicazione: (2026)

A Survey on Benchmarks of Multimodal Large Language Models
di: Li, Jian, et al.
Pubblicazione: (2024)

GODBench: A Benchmark for Multimodal Large Language Models in Video Comment Art
di: Lei, Yiming, et al.
Pubblicazione: (2025)

Robust Prompt Optimization for Large Language Models Against Distribution Shifts
di: Li, Moxin, et al.
Pubblicazione: (2023)

Deconstructing Instruction-Following: A New Benchmark for Granular Evaluation of Large Language Model Instruction Compliance Abilities
di: Purpura, Alberto, et al.
Pubblicazione: (2026)

Experiences from Benchmarking Vision-Language-Action Models for Robotic Manipulation
di: Zhang, Yihao, et al.
Pubblicazione: (2025)

White-box Multimodal Jailbreaks Against Large Vision-Language Models
di: Wang, Ruofan, et al.
Pubblicazione: (2024)

Intelligent Computing Social Modeling and Methodological Innovations in Political Science in the Era of Large Language Models
di: Wang, Zhenyu, et al.
Pubblicazione: (2024)

Spatial Reasoning in Multimodal Large Language Models: A Survey of Tasks, Benchmarks and Methods
di: Liu, Weichen, et al.
Pubblicazione: (2025)

SpatialBench: Benchmarking Multimodal Large Language Models for Spatial Cognition
di: Xu, Peiran, et al.
Pubblicazione: (2025)

CIF-Bench: A Chinese Instruction-Following Benchmark for Evaluating the Generalizability of Large Language Models
di: LI, Yizhi, et al.
Pubblicazione: (2024)

ChartM$^3$: Benchmarking Chart Editing with Multimodal Instructions
di: Yang, Donglu, et al.
Pubblicazione: (2025)

Benchmarking Multimodal Knowledge Conflict for Large Multimodal Models
di: Jia, Yifan, et al.
Pubblicazione: (2025)

ABC-Eval: Benchmarking Large Language Models on Symbolic Music Understanding and Instruction Following
di: Zhao, Jiahao, et al.
Pubblicazione: (2025)

Text Steganography with Dynamic Codebook and Multimodal Large Language Model
di: Gao, Jianxin, et al.
Pubblicazione: (2026)

Lost in the Hype: Revealing and Dissecting the Performance Degradation of Medical Multimodal Large Language Models in Image Classification
di: Zhu, Xun, et al.
Pubblicazione: (2026)

Defending Large Language Models Against Jailbreak Attacks via Layer-specific Editing
di: Zhao, Wei, et al.
Pubblicazione: (2024)

A Survey on Multimodal Benchmarks: In the Era of Large AI Models
di: Li, Lin, et al.
Pubblicazione: (2024)

Enterprise Large Language Model Evaluation Benchmark
di: Wang, Liya, et al.
Pubblicazione: (2025)

Image Generation from Contextually-Contradictory Prompts
di: Huberman, Saar, et al.
Pubblicazione: (2025)

When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions
di: Larbi, Maya, et al.
Pubblicazione: (2025)

Towards Robust Instruction Tuning on Multimodal Large Language Models
di: Han, Wei, et al.
Pubblicazione: (2024)

Advancing Multimodal Large Language Models in Chart Question Answering with Visualization-Referenced Instruction Tuning
di: Zeng, Xingchen, et al.
Pubblicazione: (2024)

MMAD: A Comprehensive Benchmark for Multimodal Large Language Models in Industrial Anomaly Detection
di: Jiang, Xi, et al.
Pubblicazione: (2024)

Rationality Check! Benchmarking the Rationality of Large Language Models
di: Zhou, Zhilun, et al.
Pubblicazione: (2025)

DatasetResearch: Benchmarking Agent Systems for Demand-Driven Dataset Discovery
di: Li, Keyu, et al.
Pubblicazione: (2025)

A Novel Approach to for Multimodal Emotion Recognition : Multimodal semantic information fusion
di: Dai, Wei, et al.
Pubblicazione: (2025)

Now You Hear Me: Audio Narrative Attacks Against Large Audio-Language Models
di: Yu, Ye, et al.
Pubblicazione: (2026)