Saved in:
Bibliographic Details
Main Authors: Yu, Xinquan, Sheng, Ziqi, Lu, Wei, Luo, Xiangyang, Zhou, Jiantao
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2412.18254
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916541538238464
author Yu, Xinquan
Sheng, Ziqi
Lu, Wei
Luo, Xiangyang
Zhou, Jiantao
author_facet Yu, Xinquan
Sheng, Ziqi
Lu, Wei
Luo, Xiangyang
Zhou, Jiantao
contents Multimodal fake news detection aims to automatically identify real or fake news, thereby mitigating the adverse effects caused by such misinformation. Although prevailing approaches have demonstrated their effectiveness, challenges persist in cross-modal feature fusion and refinement for classification. To address this, we present a residual-aware compensation network with multi-granularity constraints (RaCMC) for fake news detection, that aims to sufficiently interact and fuse cross-modal features while amplifying the differences between real and fake news. First, a multiscale residual-aware compensation module is designed to interact and fuse features at different scales, and ensure both the consistency and exclusivity of feature interaction, thus acquiring high-quality features. Second, a multi-granularity constraints module is implemented to limit the distribution of both the news overall and the image-text pairs within the news, thus amplifying the differences between real and fake news at the news and feature levels. Finally, a dominant feature fusion reasoning module is developed to comprehensively evaluate news authenticity from the perspectives of both consistency and inconsistency. Experiments on three public datasets, including Weibo17, Politifact and GossipCop, reveal the superiority of the proposed method.
format Preprint
id arxiv_https___arxiv_org_abs_2412_18254
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle RaCMC: Residual-Aware Compensation Network with Multi-Granularity Constraints for Fake News Detection
Yu, Xinquan
Sheng, Ziqi
Lu, Wei
Luo, Xiangyang
Zhou, Jiantao
Computer Vision and Pattern Recognition
Multimodal fake news detection aims to automatically identify real or fake news, thereby mitigating the adverse effects caused by such misinformation. Although prevailing approaches have demonstrated their effectiveness, challenges persist in cross-modal feature fusion and refinement for classification. To address this, we present a residual-aware compensation network with multi-granularity constraints (RaCMC) for fake news detection, that aims to sufficiently interact and fuse cross-modal features while amplifying the differences between real and fake news. First, a multiscale residual-aware compensation module is designed to interact and fuse features at different scales, and ensure both the consistency and exclusivity of feature interaction, thus acquiring high-quality features. Second, a multi-granularity constraints module is implemented to limit the distribution of both the news overall and the image-text pairs within the news, thus amplifying the differences between real and fake news at the news and feature levels. Finally, a dominant feature fusion reasoning module is developed to comprehensively evaluate news authenticity from the perspectives of both consistency and inconsistency. Experiments on three public datasets, including Weibo17, Politifact and GossipCop, reveal the superiority of the proposed method.
title RaCMC: Residual-Aware Compensation Network with Multi-Granularity Constraints for Fake News Detection
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2412.18254