KEN: Knowledge Augmentation and Emotion Guidance Network for Multimodal Fake News Detection

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Zhu, Peican, Jing, Yubo, Cheng, Le, Tang, Keke, Guo, Yangming
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866915394781970432
author Zhu, Peican
Jing, Yubo
Cheng, Le
Tang, Keke
Guo, Yangming
author_facet Zhu, Peican
Jing, Yubo
Cheng, Le
Tang, Keke
Guo, Yangming
contents In recent years, the rampant spread of misinformation on social media has made accurate detection of multimodal fake news a critical research focus. However, previous research has not adequately understood the semantics of images, and models struggle to discern news authenticity with limited textual information. Meanwhile, treating all emotional types of news uniformly without tailored approaches further leads to performance degradation. Therefore, we propose a novel Knowledge Augmentation and Emotion Guidance Network (KEN). On the one hand, we effectively leverage LVLM's powerful semantic understanding and extensive world knowledge. For images, the generated captions provide a comprehensive understanding of image content and scenes, while for text, the retrieved evidence helps break the information silos caused by the closed and limited text and context. On the other hand, we consider inter-class differences between different emotional types of news through balanced learning, achieving fine-grained modeling of the relationship between emotional types and authenticity. Extensive experiments on two real-world datasets demonstrate the superiority of our KEN.
format Preprint
id arxiv_https___arxiv_org_abs_2507_09647
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle KEN: Knowledge Augmentation and Emotion Guidance Network for Multimodal Fake News Detection
Zhu, Peican
Jing, Yubo
Cheng, Le
Tang, Keke
Guo, Yangming
Multimedia
Artificial Intelligence
In recent years, the rampant spread of misinformation on social media has made accurate detection of multimodal fake news a critical research focus. However, previous research has not adequately understood the semantics of images, and models struggle to discern news authenticity with limited textual information. Meanwhile, treating all emotional types of news uniformly without tailored approaches further leads to performance degradation. Therefore, we propose a novel Knowledge Augmentation and Emotion Guidance Network (KEN). On the one hand, we effectively leverage LVLM's powerful semantic understanding and extensive world knowledge. For images, the generated captions provide a comprehensive understanding of image content and scenes, while for text, the retrieved evidence helps break the information silos caused by the closed and limited text and context. On the other hand, we consider inter-class differences between different emotional types of news through balanced learning, achieving fine-grained modeling of the relationship between emotional types and authenticity. Extensive experiments on two real-world datasets demonstrate the superiority of our KEN.
title KEN: Knowledge Augmentation and Emotion Guidance Network for Multimodal Fake News Detection
topic Multimedia
Artificial Intelligence
url https://arxiv.org/abs/2507.09647