Divide and Conquer: Multimodal Video Deepfake Detection via Cross-Modal Fusion and Localization
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2026
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866915764311687168 |
|---|---|
| author | Li, Qingcao He, Miao Yi, Liang Wen, Qing Zhang, Yitao Jin, Hongshuo Cheng, Peng Ba, Zhongjie Lu, Li Ren, Kui |
| author_facet | Li, Qingcao He, Miao Yi, Liang Wen, Qing Zhang, Yitao Jin, Hongshuo Cheng, Peng Ba, Zhongjie Lu, Li Ren, Kui |
| contents | This paper presents a system for detecting fake audio-visual content (i.e., video deepfake), developed for Track 2 of the DDL Challenge. The proposed system employs a two-stage framework, comprising unimodal detection and multimodal score fusion. Specifically, it incorporates an audio deepfake detection module and an audio localization module to analyze and pinpoint manipulated segments in the audio stream. In parallel, an image-based deepfake detection and localization module is employed to process the visual modality. To effectively leverage complementary information across different modalities, we further propose a multimodal score fusion strategy that integrates the outputs from both audio and visual modules. Guided by a detailed analysis of the training and evaluation dataset, we explore and evaluate several score calculation and fusion strategies to improve system robustness. Overall, the final fusion-based system achieves an AUC of 0.87, an AP of 0.55, and an AR of 0.23 on the challenge test set, resulting in a final score of 0.5528. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_00209 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Divide and Conquer: Multimodal Video Deepfake Detection via Cross-Modal Fusion and Localization Li, Qingcao He, Miao Yi, Liang Wen, Qing Zhang, Yitao Jin, Hongshuo Cheng, Peng Ba, Zhongjie Lu, Li Ren, Kui Multimedia This paper presents a system for detecting fake audio-visual content (i.e., video deepfake), developed for Track 2 of the DDL Challenge. The proposed system employs a two-stage framework, comprising unimodal detection and multimodal score fusion. Specifically, it incorporates an audio deepfake detection module and an audio localization module to analyze and pinpoint manipulated segments in the audio stream. In parallel, an image-based deepfake detection and localization module is employed to process the visual modality. To effectively leverage complementary information across different modalities, we further propose a multimodal score fusion strategy that integrates the outputs from both audio and visual modules. Guided by a detailed analysis of the training and evaluation dataset, we explore and evaluate several score calculation and fusion strategies to improve system robustness. Overall, the final fusion-based system achieves an AUC of 0.87, an AP of 0.55, and an AR of 0.23 on the challenge test set, resulting in a final score of 0.5528. |
| title | Divide and Conquer: Multimodal Video Deepfake Detection via Cross-Modal Fusion and Localization |
| topic | Multimedia |
| url | https://arxiv.org/abs/2602.00209 |