Guardado en:
| Autores principales: | , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | https://arxiv.org/abs/2409.00022 |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866909302059433984 |
|---|---|
| author | Fu, Zhe Wang, Kanlun Xin, Wangjiaxuan Zhou, Lina Chen, Shi Ge, Yaorong Janies, Daniel Zhang, Dongsong |
| author_facet | Fu, Zhe Wang, Kanlun Xin, Wangjiaxuan Zhou, Lina Chen, Shi Ge, Yaorong Janies, Daniel Zhang, Dongsong |
| contents | The landscape of social media content has evolved significantly, extending from text to multimodal formats. This evolution presents a significant challenge in combating misinformation. Previous research has primarily focused on single modalities or text-image combinations, leaving a gap in detecting multimodal misinformation. While the concept of entity consistency holds promise in detecting multimodal misinformation, simplifying the representation to a scalar value overlooks the inherent complexities of high-dimensional representations across different modalities. To address these limitations, we propose a Multimedia Misinformation Detection (MultiMD) framework for detecting misinformation from video content by leveraging cross-modal entity consistency. The proposed dual learning approach allows for not only enhancing misinformation detection performance but also improving representation learning of entity consistency across different modalities. Our results demonstrate that MultiMD outperforms state-of-the-art baseline models and underscore the importance of each modality in misinformation detection. Our research provides novel methodological and technical insights into multimodal misinformation detection. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_00022 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Detecting Misinformation in Multimedia Content through Cross-Modal Entity Consistency: A Dual Learning Approach Fu, Zhe Wang, Kanlun Xin, Wangjiaxuan Zhou, Lina Chen, Shi Ge, Yaorong Janies, Daniel Zhang, Dongsong Multimedia Artificial Intelligence Computer Vision and Pattern Recognition The landscape of social media content has evolved significantly, extending from text to multimodal formats. This evolution presents a significant challenge in combating misinformation. Previous research has primarily focused on single modalities or text-image combinations, leaving a gap in detecting multimodal misinformation. While the concept of entity consistency holds promise in detecting multimodal misinformation, simplifying the representation to a scalar value overlooks the inherent complexities of high-dimensional representations across different modalities. To address these limitations, we propose a Multimedia Misinformation Detection (MultiMD) framework for detecting misinformation from video content by leveraging cross-modal entity consistency. The proposed dual learning approach allows for not only enhancing misinformation detection performance but also improving representation learning of entity consistency across different modalities. Our results demonstrate that MultiMD outperforms state-of-the-art baseline models and underscore the importance of each modality in misinformation detection. Our research provides novel methodological and technical insights into multimodal misinformation detection. |
| title | Detecting Misinformation in Multimedia Content through Cross-Modal Entity Consistency: A Dual Learning Approach |
| topic | Multimedia Artificial Intelligence Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2409.00022 |