Official-NV: An LLM-Generated News Video Dataset for Multimodal Fake News Detection

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wang, Yihao, Chen, Lizhi, Qian, Zhong, Li, Peifeng
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917879331422208
author Wang, Yihao
Chen, Lizhi
Qian, Zhong
Li, Peifeng
author_facet Wang, Yihao
Chen, Lizhi
Qian, Zhong
Li, Peifeng
contents News media, especially video news media, have penetrated into every aspect of daily life, which also brings the risk of fake news. Therefore, multimodal fake news detection has recently garnered increased attention. However, the existing datasets are comprised of user-uploaded videos and contain an excess amounts of superfluous data, which introduces noise into the model training process. To address this issue, we construct a dataset named Official-NV, comprising officially published news videos. The crawl officially published videos are augmented through the use of LLMs-based generation and manual verification, thereby expanding the dataset. We also propose a new baseline model called OFNVD, which captures key information from multimodal features through a GLU attention mechanism and performs feature enhancement and modal aggregation via a cross-modal Transformer. Benchmarking the dataset and baselines demonstrates the effectiveness of our model in multimodal news detection.
format Preprint
id arxiv_https___arxiv_org_abs_2407_19493
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Official-NV: An LLM-Generated News Video Dataset for Multimodal Fake News Detection
Wang, Yihao
Chen, Lizhi
Qian, Zhong
Li, Peifeng
Computer Vision and Pattern Recognition
Artificial Intelligence
Multimedia
News media, especially video news media, have penetrated into every aspect of daily life, which also brings the risk of fake news. Therefore, multimodal fake news detection has recently garnered increased attention. However, the existing datasets are comprised of user-uploaded videos and contain an excess amounts of superfluous data, which introduces noise into the model training process. To address this issue, we construct a dataset named Official-NV, comprising officially published news videos. The crawl officially published videos are augmented through the use of LLMs-based generation and manual verification, thereby expanding the dataset. We also propose a new baseline model called OFNVD, which captures key information from multimodal features through a GLU attention mechanism and performs feature enhancement and modal aggregation via a cross-modal Transformer. Benchmarking the dataset and baselines demonstrates the effectiveness of our model in multimodal news detection.
title Official-NV: An LLM-Generated News Video Dataset for Multimodal Fake News Detection
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Multimedia
url https://arxiv.org/abs/2407.19493