Cover Image

Is Cognition Consistent with Perception? Assessing and Mitigating Multimodal Knowledge Conflicts in Document Understanding

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Shao, Zirui, Gao, Feiyu, Zhu, Zhaoqing, Luo, Chuwei, Xing, Hangdi, Yu, Zhi, Zheng, Qi, Yan, Ming, Bu, Jiajun
Format:	Preprint
Published:	2024
Subjects:	Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Simple yet Effective Layout Token in Large Language Models for Document Understanding
by: Zhu, Zhaoqing, et al.
Published: (2025)

WebRPG: Automatic Web Rendering Parameters Generation for Visual Presentation
by: Shao, Zirui, et al.
Published: (2024)

ProcTag: Process Tagging for Assessing the Efficacy of Document Instruction Data
by: Shen, Yufan, et al.
Published: (2024)

LayoutLLM: Layout Instruction Tuning with Large Language Models for Document Understanding
by: Luo, Chuwei, et al.
Published: (2024)

Doc-CoB: Enhancing Document Understanding with Visual Chain-of-Boxes Reasoning
by: Mo, Ye, et al.
Published: (2025)

BrailleLLM: Braille Instruction Tuning with Large Language Models for Braille Domain Tasks
by: Huang, Tianyuan, et al.
Published: (2025)

MPDocBench-Parse: Benchmarking Practical Multi-page Document Parsing
by: Zhou, Bangbang, et al.
Published: (2026)

REAL: Resolving Knowledge Conflicts in Knowledge-Intensive Visual Question Answering via Reasoning-Pivot Alignment
by: Ye, Kai, et al.
Published: (2026)

MP-GUI: Modality Perception with MLLMs for GUI Understanding
by: Wang, Ziwei, et al.
Published: (2025)

Bi-VLDoc: Bidirectional Vision-Language Modeling for Visually-Rich Document Understanding
by: Luo, Chuwei, et al.
Published: (2022)

Assessing and Mitigating Medical Knowledge Drift and Conflicts in Large Language Models
by: Wu, Weiyi, et al.
Published: (2025)

LORE++: Logical Location Regression Network for Table Structure Recognition with Pre-training
by: Long, Rujiao, et al.
Published: (2024)

Towards Scalable Web Accessibility Audit with MLLMs as Copilots
by: Gu, Ming, et al.
Published: (2025)

CC-VQA: Conflict- and Correlation-Aware Method for Mitigating Knowledge Conflict in Knowledge-Based Visual Question Answering
by: Hong, Yuyang, et al.
Published: (2026)

Mixpert: Mitigating Multimodal Learning Conflicts with Efficient Mixture-of-Vision-Experts
by: He, Xin, et al.
Published: (2025)

Multilevel Graph Reinforcement Learning for Consistent Cognitive Decision-making in Heterogeneous Mixed Autonomy
by: Gao, Xin, et al.
Published: (2024)

LongDocURL: a Comprehensive Multimodal Long Document Benchmark Integrating Understanding, Reasoning, and Locating
by: Deng, Chao, et al.
Published: (2024)

MODA: MOdular Duplex Attention for Multimodal Perception, Cognition, and Emotion Understanding
by: Zhang, Zhicheng, et al.
Published: (2025)

V2X-UniPool: Unifying Multimodal Perception and Knowledge Reasoning for Autonomous Driving
by: Luo, Xuewen, et al.
Published: (2025)

Analyzing Reasoning Consistency in Large Multimodal Models under Cross-Modal Conflicts
by: Zhu, Zhihao, et al.
Published: (2026)

Benchmarking Multimodal Knowledge Conflict for Large Multimodal Models
by: Jia, Yifan, et al.
Published: (2025)

On walk domination: Between different types of walks and $m_3$-path
by: Chen, Hangdi, et al.
Published: (2025)

The Turán number of the triangular pyramid of 4-layers
by: Chen, Hangdi, et al.
Published: (2026)

Parent–Child Conflict and Prosocial Behavior in Preschoolers: Social Information Processing Perspective
by: Zhaoqing Li, et al.
Published: (2025)

MMKE-Bench: A Multimodal Editing Benchmark for Diverse Visual Knowledge
by: Du, Yuntao, et al.
Published: (2025)

Mitigating Hallucination Through Theory-Consistent Symmetric Multimodal Preference Optimization
by: Liu, Wenqi, et al.
Published: (2025)

How Does the Textual Information Affect the Retrieval of Multimodal In-Context Learning?
by: Luo, Yang, et al.
Published: (2024)

Mitigating Knowledge Conflicts in Language Model-Driven Question Answering
by: Cao, Han, et al.
Published: (2024)

Verifying Hierarchic Multipartite and Network Nonlocalities with a Unified Method
by: Luo, Ming-Xing, et al.
Published: (2024)

R-C2: Cycle-Consistent Reinforcement Learning Improves Multimodal Reasoning
by: Zhang, Zirui, et al.
Published: (2026)

Towards Understanding Graphical Perception in Large Multimodal Models
by: Zhang, Kai, et al.
Published: (2025)

Mitigating Object Hallucination via Robust Local Perception Search
by: Gao, Zixian, et al.
Published: (2025)

Mitigating Context-Memory Conflicts in LLMs through Dynamic Cognitive Reconciliation Decoding
by: Zhou, Yigeng, et al.
Published: (2026)

Diagnosing Knowledge Conflict in Multimodal Long-Chain Reasoning
by: Tang, Jing, et al.
Published: (2026)

Cutting Off the Head Ends the Conflict: A Mechanism for Interpreting and Mitigating Knowledge Conflicts in Language Models
by: Jin, Zhuoran, et al.
Published: (2024)

Cognitive Mismatch in Multimodal Large Language Models for Discrete Symbol Understanding
by: Li, Yinghui, et al.
Published: (2026)

Mitigating Multimodal Inconsistency via Cognitive Dual-Pathway Reasoning for Intent Recognition
by: Wang, Yifan, et al.
Published: (2026)

Privacy-Preserving Federated Learning with Consistency via Knowledge Distillation Using Conditional Generator
by: Luo, Kangyang, et al.
Published: (2024)

Formality is Favored: Unraveling the Learning Preferences of Large Language Models on Data with Conflicting Knowledge
by: Li, Jiahuan, et al.
Published: (2024)

ChatRex: Taming Multimodal LLM for Joint Perception and Understanding
by: Jiang, Qing, et al.
Published: (2024)