Unveiling Deepfakes: A Frequency-Aware Triple Branch Network for Deepfake Detection

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Shen, Qihao, Xuan, Jiaxing, Liu, Zhenguang, Wu, Sifan, Xie, Yutong, Ming, Zhaoyan, Jiao, Yingying, Ren, kui
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866908978285379584
author Shen, Qihao
Xuan, Jiaxing
Liu, Zhenguang
Wu, Sifan
Xie, Yutong
Ming, Zhaoyan
Jiao, Yingying
Ren, kui
author_facet Shen, Qihao
Xuan, Jiaxing
Liu, Zhenguang
Wu, Sifan
Xie, Yutong
Ming, Zhaoyan
Jiao, Yingying
Ren, kui
contents Advanced deepfake technologies are blurring the lines between real and fake, presenting both revolutionary opportunities and alarming threats. While it unlocks novel applications in fields like entertainment and education, its malicious use has sparked urgent ethical and societal concerns ranging from identity theft to the dissemination of misinformation. To tackle these challenges, feature analysis using frequency features has emergedas a promising direction for deepfake detection. However, oneaspect that has been overlooked so far is that existing methodstend to concentrate on one or a few specific frequency domains,which risks overfitting to particular artifacts and significantlyundermines their robustness when facing diverse forgery patterns. Another underexplored aspect we observe is that different features often attend to the same forged region, resulting in redundant feature representations and limiting the diversity of the extracted clues. This may undermine the ability of a model to capture complementary information across different facets, thereby compromising its generalization capability to diverse manipulations. In this paper, we seek to tackle these challenges from two aspects: (1) we propose a triple-branch network that jointly captures spatial and frequency features by learning from both original image and image reconstructed by different frequency channels, and (2) we mathematically derive feature decoupling and fusion losses grounded in the mutual information theory, which enhances the model to focus on task-relevant features across the original image and the image reconstructed by different frequency channels. Extensive experiments on six large-scale benchmark datasets demonstrate that our method consistently achieves state-of-the-art performance. Our code is released at https://github.com/injooker/Unveiling Deepfake.
format Preprint
id arxiv_https___arxiv_org_abs_2604_17477
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Unveiling Deepfakes: A Frequency-Aware Triple Branch Network for Deepfake Detection
Shen, Qihao
Xuan, Jiaxing
Liu, Zhenguang
Wu, Sifan
Xie, Yutong
Ming, Zhaoyan
Jiao, Yingying
Ren, kui
Computer Vision and Pattern Recognition
Machine Learning
Advanced deepfake technologies are blurring the lines between real and fake, presenting both revolutionary opportunities and alarming threats. While it unlocks novel applications in fields like entertainment and education, its malicious use has sparked urgent ethical and societal concerns ranging from identity theft to the dissemination of misinformation. To tackle these challenges, feature analysis using frequency features has emergedas a promising direction for deepfake detection. However, oneaspect that has been overlooked so far is that existing methodstend to concentrate on one or a few specific frequency domains,which risks overfitting to particular artifacts and significantlyundermines their robustness when facing diverse forgery patterns. Another underexplored aspect we observe is that different features often attend to the same forged region, resulting in redundant feature representations and limiting the diversity of the extracted clues. This may undermine the ability of a model to capture complementary information across different facets, thereby compromising its generalization capability to diverse manipulations. In this paper, we seek to tackle these challenges from two aspects: (1) we propose a triple-branch network that jointly captures spatial and frequency features by learning from both original image and image reconstructed by different frequency channels, and (2) we mathematically derive feature decoupling and fusion losses grounded in the mutual information theory, which enhances the model to focus on task-relevant features across the original image and the image reconstructed by different frequency channels. Extensive experiments on six large-scale benchmark datasets demonstrate that our method consistently achieves state-of-the-art performance. Our code is released at https://github.com/injooker/Unveiling Deepfake.
title Unveiling Deepfakes: A Frequency-Aware Triple Branch Network for Deepfake Detection
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2604.17477