Cover Image

Challenges in Understanding Modality Conflict in Vision-Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Nguyen, Trang, Michaels, Jackson, Fiterau, Madalina, Jensen, David
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Leveraging Foundation Language Models (FLMs) for Automated Cohort Extraction from Large EHR Databases
by: Mugambi, Purity, et al.
Published: (2024)

Resolution-Aware Retrieval Augmented Zero-Shot Forecasting
by: Deznabi, Iman, et al.
Published: (2025)

Zero-shot Microclimate Prediction with Deep Learning
by: Deznabi, Iman, et al.
Published: (2024)

A/B testing under Interference with Partial Network Information
by: Shankar, Shiv, et al.
Published: (2024)

Audio-Visual Speech Separation via Bottleneck Iterative Network
by: Zhang, Sidong, et al.
Published: (2025)

How Do Vision-Language Models Process Conflicting Information Across Modalities?
by: Hua, Tianze, et al.
Published: (2025)

Statistical Advantages of Perturbing Cosine Router in Mixture of Experts
by: Nguyen, Huy, et al.
Published: (2024)

Mixture of Experts Meets Prompt-Based Continual Learning
by: Le, Minh, et al.
Published: (2024)

Studying Large Language Model Behaviors Under Context-Memory Conflicts With Real Documents
by: Kortukov, Evgenii, et al.
Published: (2024)

Routing Absorption in Sparse Attention: Why Random Gates Are Hard to Beat
by: Aquino-Michaels, Keston
Published: (2026)

On the Cone Effect and Modality Gap in Medical Vision-Language Embeddings
by: Restrepo, David, et al.
Published: (2026)

Tactile Modality Fusion for Vision-Language-Action Models
by: Morissette, Charlotte, et al.
Published: (2026)

Correctness Assessment of Code Generated by Large Language Models Using Internal Representations
by: Bui, Tuan-Dung, et al.
Published: (2025)

Attack On Prompt: Backdoor Attack in Prompt-Based Continual Learning
by: Nguyen, Trang, et al.
Published: (2024)

Robust Explainer Recommendation for Time Series Classification
by: Nguyen, Thu Trang, et al.
Published: (2023)

Understanding and Mitigating Miscalibration in Prompt Tuning for Vision-Language Models
by: Wang, Shuoyuan, et al.
Published: (2024)

Vision Language Models are Biased
by: Vo, An, et al.
Published: (2025)

Data Selection for Fine-tuning Vision Language Models via Cross Modal Alignment Trajectories
by: Naharas, Nilay, et al.
Published: (2025)

Implicit Jailbreak Attacks via Cross-Modal Information Concealment on Vision-Language Models
by: Wang, Zhaoxin, et al.
Published: (2025)

Quantifying Cross-Modality Memorization in Vision-Language Models
by: Wen, Yuxin, et al.
Published: (2025)

Improved Alignment of Modalities in Large Vision Language Models
by: Jangra, Kartik, et al.
Published: (2025)

That's Deprecated! Understanding, Detecting, and Steering Knowledge Conflicts in Language Models for Code Generation
by: Bae, Jaesung, et al.
Published: (2025)

OmniVLA: An Omni-Modal Vision-Language-Action Model for Robot Navigation
by: Hirose, Noriaki, et al.
Published: (2025)

Multi-Modal Adapter for Vision-Language Models
by: Seputis, Dominykas, et al.
Published: (2024)

ExGra-Med: Extended Context Graph Alignment for Medical Vision-Language Models
by: Nguyen, Duy M. H., et al.
Published: (2024)

Cross-Modality Controlled Molecule Generation with Diffusion Language Model
by: Zhang, Yunzhe, et al.
Published: (2025)

Language Models are Bounded Pragmatic Speakers: Understanding RLHF from a Bayesian Cognitive Modeling Perspective
by: Nguyen, Khanh
Published: (2023)

Understanding Task Transfer in Vision-Language Models
by: Sachdeva, Bhuvan, et al.
Published: (2025)

Taming Knowledge Conflicts in Language Models
by: Li, Gaotang, et al.
Published: (2025)

MMRL: Multi-Modal Representation Learning for Vision-Language Models
by: Guo, Yuncheng, et al.
Published: (2025)

Information Router for Mitigating Modality Dominance in Vision-Language Models
by: Kim, Seulgi, et al.
Published: (2026)

Bridge the Modality and Capability Gaps in Vision-Language Model Selection
by: Yi, Chao, et al.
Published: (2024)

Understanding Why Large Language Models Can Be Ineffective in Time Series Analysis: The Impact of Modality Alignment
by: Zheng, Liangwei Nathan, et al.
Published: (2024)

Feedback-Enhanced Hallucination-Resistant Vision-Language Model for Real-Time Scene Understanding
by: Alsulaimawi, Zahir
Published: (2025)

Jailbreaking Vision-Language Models Through the Visual Modality
by: Azulay, Aharon, et al.
Published: (2026)

Understanding Asynchronous Inference Methods for Vision-Language-Action Models
by: Agouzoul, Ayoub
Published: (2026)

Adjusted Shuffling SARAH: Advancing Complexity Analysis via Dynamic Gradient Weighting
by: Nguyen, Duc Toan, et al.
Published: (2025)

Understanding the Dynamics of Demonstration Conflict in In-Context Learning
by: Jiao, Difan, et al.
Published: (2026)

ALF: Advertiser Large Foundation Model for Multi-Modal Advertiser Understanding
by: Rajagopalan, Santosh, et al.
Published: (2025)

Beyond Accuracy: On the Effects of Fine-tuning Towards Vision-Language Model's Prediction Rationality
by: Wang, Qitong, et al.
Published: (2024)