A Novel Unified Approach to Deepfake Detection

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Sen, Lord, Mukherjee, Shyamapada
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914237700374528
author Sen, Lord
Mukherjee, Shyamapada
author_facet Sen, Lord
Mukherjee, Shyamapada
contents The advancements in the field of AI is increasingly giving rise to various threats. One of the most prominent of them is the synthesis and misuse of Deepfakes. To sustain trust in this digital age, detection and tagging of deepfakes is very necessary. In this paper, a novel architecture for Deepfake detection in images and videos is presented. The architecture uses cross attention between spatial and frequency domain features along with a blood detection module to classify an image as real or fake. This paper aims to develop a unified architecture and provide insights into each step. Though this approach we achieve results better than SOTA, specifically 99.80%, 99.88% AUC on FF++ and Celeb-DF upon using Swin Transformer and BERT and 99.55, 99.38 while using EfficientNet-B4 and BERT. The approach also generalizes very well achieving great cross dataset results as well.
format Preprint
id arxiv_https___arxiv_org_abs_2601_03382
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle A Novel Unified Approach to Deepfake Detection
Sen, Lord
Mukherjee, Shyamapada
Computer Vision and Pattern Recognition
The advancements in the field of AI is increasingly giving rise to various threats. One of the most prominent of them is the synthesis and misuse of Deepfakes. To sustain trust in this digital age, detection and tagging of deepfakes is very necessary. In this paper, a novel architecture for Deepfake detection in images and videos is presented. The architecture uses cross attention between spatial and frequency domain features along with a blood detection module to classify an image as real or fake. This paper aims to develop a unified architecture and provide insights into each step. Though this approach we achieve results better than SOTA, specifically 99.80%, 99.88% AUC on FF++ and Celeb-DF upon using Swin Transformer and BERT and 99.55, 99.38 while using EfficientNet-B4 and BERT. The approach also generalizes very well achieving great cross dataset results as well.
title A Novel Unified Approach to Deepfake Detection
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2601.03382