Robust AI-Generated Face Detection with Imbalanced Data

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Krubha, Yamini Sri, Hou, Aryana, Vester, Braden, Walker, Web, Wang, Xin, Lin, Li, Hu, Shu
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866915273081094144
author Krubha, Yamini Sri
Hou, Aryana
Vester, Braden
Walker, Web
Wang, Xin
Lin, Li
Hu, Shu
author_facet Krubha, Yamini Sri
Hou, Aryana
Vester, Braden
Walker, Web
Wang, Xin
Lin, Li
Hu, Shu
contents Deepfakes, created using advanced AI techniques such as Variational Autoencoder and Generative Adversarial Networks, have evolved from research and entertainment applications into tools for malicious activities, posing significant threats to digital trust. Current deepfake detection techniques have evolved from CNN-based methods focused on local artifacts to more advanced approaches using vision transformers and multimodal models like CLIP, which capture global anomalies and improve cross-domain generalization. Despite recent progress, state-of-the-art deepfake detectors still face major challenges in handling distribution shifts from emerging generative models and addressing severe class imbalance between authentic and fake samples in deepfake datasets, which limits their robustness and detection accuracy. To address these challenges, we propose a framework that combines dynamic loss reweighting and ranking-based optimization, which achieves superior generalization and performance under imbalanced dataset conditions. The code is available at https://github.com/Purdue-M2/SP_CUP.
format Preprint
id arxiv_https___arxiv_org_abs_2505_02182
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Robust AI-Generated Face Detection with Imbalanced Data
Krubha, Yamini Sri
Hou, Aryana
Vester, Braden
Walker, Web
Wang, Xin
Lin, Li
Hu, Shu
Computer Vision and Pattern Recognition
Deepfakes, created using advanced AI techniques such as Variational Autoencoder and Generative Adversarial Networks, have evolved from research and entertainment applications into tools for malicious activities, posing significant threats to digital trust. Current deepfake detection techniques have evolved from CNN-based methods focused on local artifacts to more advanced approaches using vision transformers and multimodal models like CLIP, which capture global anomalies and improve cross-domain generalization. Despite recent progress, state-of-the-art deepfake detectors still face major challenges in handling distribution shifts from emerging generative models and addressing severe class imbalance between authentic and fake samples in deepfake datasets, which limits their robustness and detection accuracy. To address these challenges, we propose a framework that combines dynamic loss reweighting and ranking-based optimization, which achieves superior generalization and performance under imbalanced dataset conditions. The code is available at https://github.com/Purdue-M2/SP_CUP.
title Robust AI-Generated Face Detection with Imbalanced Data
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2505.02182