Multimodal Inverse Attention Network with Intrinsic Discriminant Feature Exploitation for Fake News Detection

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Zhang, Tianlin, Yu, En, Shao, Yi, Sun, Jiande
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913865651978240
author Zhang, Tianlin
Yu, En
Shao, Yi
Sun, Jiande
author_facet Zhang, Tianlin
Yu, En
Shao, Yi
Sun, Jiande
contents Multimodal fake news detection has garnered significant attention due to its profound implications for social security. While existing approaches have contributed to understanding cross-modal consistency, they often fail to leverage modal-specific representations and explicit discrepant features. To address these limitations, we propose a Multimodal Inverse Attention Network (MIAN), a novel framework that explores intrinsic discriminative features based on news content to advance fake news detection. Specifically, MIAN introduces a hierarchical learning module that captures diverse intra-modal relationships through local-to-global and local-to-local interactions, thereby generating enhanced unimodal representations to improve the identification of fake news at the intra-modal level. Additionally, a cross-modal interaction module employs a co-attention mechanism to establish and model dependencies between the refined unimodal representations, facilitating seamless semantic integration across modalities. To explicitly extract inconsistency features, we propose an inverse attention mechanism that effectively highlights the conflicting patterns and semantic deviations introduced by fake news in both intra- and inter-modality. Extensive experiments on benchmark datasets demonstrate that MIAN significantly outperforms state-of-the-art methods, underscoring its pivotal contribution to advancing social security through enhanced multimodal fake news detection.
format Preprint
id arxiv_https___arxiv_org_abs_2502_01699
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Multimodal Inverse Attention Network with Intrinsic Discriminant Feature Exploitation for Fake News Detection
Zhang, Tianlin
Yu, En
Shao, Yi
Sun, Jiande
Machine Learning
Computation and Language
Computer Vision and Pattern Recognition
Information Retrieval
Multimedia
Multimodal fake news detection has garnered significant attention due to its profound implications for social security. While existing approaches have contributed to understanding cross-modal consistency, they often fail to leverage modal-specific representations and explicit discrepant features. To address these limitations, we propose a Multimodal Inverse Attention Network (MIAN), a novel framework that explores intrinsic discriminative features based on news content to advance fake news detection. Specifically, MIAN introduces a hierarchical learning module that captures diverse intra-modal relationships through local-to-global and local-to-local interactions, thereby generating enhanced unimodal representations to improve the identification of fake news at the intra-modal level. Additionally, a cross-modal interaction module employs a co-attention mechanism to establish and model dependencies between the refined unimodal representations, facilitating seamless semantic integration across modalities. To explicitly extract inconsistency features, we propose an inverse attention mechanism that effectively highlights the conflicting patterns and semantic deviations introduced by fake news in both intra- and inter-modality. Extensive experiments on benchmark datasets demonstrate that MIAN significantly outperforms state-of-the-art methods, underscoring its pivotal contribution to advancing social security through enhanced multimodal fake news detection.
title Multimodal Inverse Attention Network with Intrinsic Discriminant Feature Exploitation for Fake News Detection
topic Machine Learning
Computation and Language
Computer Vision and Pattern Recognition
Information Retrieval
Multimedia
url https://arxiv.org/abs/2502.01699