A Self-Learning Multimodal Approach for Fake News Detection

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Chen, Hao, Guo, Hui, Hu, Baochen, Hu, Shu, Hu, Jinrong, Lyu, Siwei, Wu, Xi, Wang, Xin
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912147934543872
author Chen, Hao
Guo, Hui
Hu, Baochen
Hu, Shu
Hu, Jinrong
Lyu, Siwei
Wu, Xi
Wang, Xin
author_facet Chen, Hao
Guo, Hui
Hu, Baochen
Hu, Shu
Hu, Jinrong
Lyu, Siwei
Wu, Xi
Wang, Xin
contents The rapid growth of social media has resulted in an explosion of online news content, leading to a significant increase in the spread of misleading or false information. While machine learning techniques have been widely applied to detect fake news, the scarcity of labeled datasets remains a critical challenge. Misinformation frequently appears as paired text and images, where a news article or headline is accompanied by a related visuals. In this paper, we introduce a self-learning multimodal model for fake news classification. The model leverages contrastive learning, a robust method for feature extraction that operates without requiring labeled data, and integrates the strengths of Large Language Models (LLMs) to jointly analyze both text and image features. LLMs are excel at this task due to their ability to process diverse linguistic data drawn from extensive training corpora. Our experimental results on a public dataset demonstrate that the proposed model outperforms several state-of-the-art classification approaches, achieving over 85% accuracy, precision, recall, and F1-score. These findings highlight the model's effectiveness in tackling the challenges of multimodal fake news detection.
format Preprint
id arxiv_https___arxiv_org_abs_2412_05843
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A Self-Learning Multimodal Approach for Fake News Detection
Chen, Hao
Guo, Hui
Hu, Baochen
Hu, Shu
Hu, Jinrong
Lyu, Siwei
Wu, Xi
Wang, Xin
Computation and Language
Machine Learning
The rapid growth of social media has resulted in an explosion of online news content, leading to a significant increase in the spread of misleading or false information. While machine learning techniques have been widely applied to detect fake news, the scarcity of labeled datasets remains a critical challenge. Misinformation frequently appears as paired text and images, where a news article or headline is accompanied by a related visuals. In this paper, we introduce a self-learning multimodal model for fake news classification. The model leverages contrastive learning, a robust method for feature extraction that operates without requiring labeled data, and integrates the strengths of Large Language Models (LLMs) to jointly analyze both text and image features. LLMs are excel at this task due to their ability to process diverse linguistic data drawn from extensive training corpora. Our experimental results on a public dataset demonstrate that the proposed model outperforms several state-of-the-art classification approaches, achieving over 85% accuracy, precision, recall, and F1-score. These findings highlight the model's effectiveness in tackling the challenges of multimodal fake news detection.
title A Self-Learning Multimodal Approach for Fake News Detection
topic Computation and Language
Machine Learning
url https://arxiv.org/abs/2412.05843