Saved in:
Bibliographic Details
Main Authors: Wu, Haotian, Cheng, Yue, Bian, Shan
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2604.14574
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908969651404800
author Wu, Haotian
Cheng, Yue
Bian, Shan
author_facet Wu, Haotian
Cheng, Yue
Bian, Shan
contents With the rapid advancement of deep learning in image generation, facial forgery techniques have achieved unprecedented realism, posing serious threats to cybersecurity and information authenticity. Most existing deepfake detection approaches rely on the reconstruction of isolated facial attributes without fully exploiting the complementary nature of multi-modal feature representations. To address these challenges, this paper proposes a novel Multi-Modal 3D Facial Feature Reconstruction Network (M3D-Net) for deepfake detection. Our method leverages an end-to-end dual-stream architecture that reconstructs fine-grained facial geometry and reflectance properties from single-view RGB images via a self-supervised 3D facial reconstruction module. The network further enhances detection performance through a 3D Feature Pre-fusion Module (PFM), which adaptively adjusts multi-scale features, and a Multi-modal Fusion Module (MFM) that effectively integrates RGB and 3D-reconstructed features using attention mechanisms. Extensive experiments on multiple public datasets demonstrate that our approach achieves state-of-the-art performance in terms of detection accuracy and robustness, significantly outperforming existing methods while exhibiting strong generalization across diverse scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2604_14574
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle M3D-Net: Multi-Modal 3D Facial Feature Reconstruction Network for Deepfake Detection
Wu, Haotian
Cheng, Yue
Bian, Shan
Computer Vision and Pattern Recognition
With the rapid advancement of deep learning in image generation, facial forgery techniques have achieved unprecedented realism, posing serious threats to cybersecurity and information authenticity. Most existing deepfake detection approaches rely on the reconstruction of isolated facial attributes without fully exploiting the complementary nature of multi-modal feature representations. To address these challenges, this paper proposes a novel Multi-Modal 3D Facial Feature Reconstruction Network (M3D-Net) for deepfake detection. Our method leverages an end-to-end dual-stream architecture that reconstructs fine-grained facial geometry and reflectance properties from single-view RGB images via a self-supervised 3D facial reconstruction module. The network further enhances detection performance through a 3D Feature Pre-fusion Module (PFM), which adaptively adjusts multi-scale features, and a Multi-modal Fusion Module (MFM) that effectively integrates RGB and 3D-reconstructed features using attention mechanisms. Extensive experiments on multiple public datasets demonstrate that our approach achieves state-of-the-art performance in terms of detection accuracy and robustness, significantly outperforming existing methods while exhibiting strong generalization across diverse scenarios.
title M3D-Net: Multi-Modal 3D Facial Feature Reconstruction Network for Deepfake Detection
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2604.14574