Towards Generalizable Deepfake Image Detection with Vision Transformers
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866910146056159232 |
|---|---|
| author | Srinanda, Kaliki V Prabhu, M Manvith Mogilipalem, Hemanth K Abhinai, Jayavarapu S Santhosh, Vaibhav Herur, Aryan Vijayasenan, Deepu |
| author_facet | Srinanda, Kaliki V Prabhu, M Manvith Mogilipalem, Hemanth K Abhinai, Jayavarapu S Santhosh, Vaibhav Herur, Aryan Vijayasenan, Deepu |
| contents | In today's day and age, we face a challenge in detecting deepfake images because of the fast evolution of modern generative models and the poor generalization capability of existing methods. In this paper, we use an ensemble of fine-tuned vision transformers like DINOv2, AIMv2 and OpenCLIP's ViT-L/14 to create generalizable method to detect deepfakes. We use the DF-Wild dataset released as part of the IEEE SP Cup 2025, because it uses a challenging and diverse set of manipulations and generation techniques. We started our experiments with CNN classifiers trained on spatial features. Experimental results show that our ensemble outperforms individual models and strong CNN baselines, achieving an AUC of 96.77% and an Equal Error Rate (EER) of just 9% on the DF-Wild test set, beating the state-of-the-art deepfake detection algorithm Effort by 7.05% and 8% in AUC and EER respectively. This was the winning solution for SP Cup, presented at ICASSP 2025. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_17376 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Towards Generalizable Deepfake Image Detection with Vision Transformers Srinanda, Kaliki V Prabhu, M Manvith Mogilipalem, Hemanth K Abhinai, Jayavarapu S Santhosh, Vaibhav Herur, Aryan Vijayasenan, Deepu Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning Image and Video Processing In today's day and age, we face a challenge in detecting deepfake images because of the fast evolution of modern generative models and the poor generalization capability of existing methods. In this paper, we use an ensemble of fine-tuned vision transformers like DINOv2, AIMv2 and OpenCLIP's ViT-L/14 to create generalizable method to detect deepfakes. We use the DF-Wild dataset released as part of the IEEE SP Cup 2025, because it uses a challenging and diverse set of manipulations and generation techniques. We started our experiments with CNN classifiers trained on spatial features. Experimental results show that our ensemble outperforms individual models and strong CNN baselines, achieving an AUC of 96.77% and an Equal Error Rate (EER) of just 9% on the DF-Wild test set, beating the state-of-the-art deepfake detection algorithm Effort by 7.05% and 8% in AUC and EER respectively. This was the winning solution for SP Cup, presented at ICASSP 2025. |
| title | Towards Generalizable Deepfake Image Detection with Vision Transformers |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning Image and Video Processing |
| url | https://arxiv.org/abs/2604.17376 |