Fake It till You Make It: Curricular Dynamic Forgery Augmentations towards General Deepfake Detection
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866917782101164032 |
|---|---|
| author | Lin, Yuzhen Song, Wentang Li, Bin Li, Yuezun Ni, Jiangqun Chen, Han Li, Qiushi |
| author_facet | Lin, Yuzhen Song, Wentang Li, Bin Li, Yuezun Ni, Jiangqun Chen, Han Li, Qiushi |
| contents | Previous studies in deepfake detection have shown promising results when testing face forgeries from the same dataset as the training.
However, the problem remains challenging when one tries to generalize the detector to forgeries from unseen datasets and created by unseen methods.
In this work, we present a novel general deepfake detection method, called \textbf{C}urricular \textbf{D}ynamic \textbf{F}orgery \textbf{A}ugmentation (CDFA), which jointly trains a deepfake detector with a forgery augmentation policy network.
Unlike the previous works, we propose to progressively apply forgery augmentations following a monotonic curriculum during the training.
We further propose a dynamic forgery searching strategy to select one suitable forgery augmentation operation for each image varying between training stages, producing a forgery augmentation policy optimized for better generalization.
In addition, we propose a novel forgery augmentation named self-shifted blending image to simply imitate the temporal inconsistency of deepfake generation.
Comprehensive experiments show that CDFA can significantly improve both cross-datasets and cross-manipulations performances of various naive deepfake detectors in a plug-and-play way, and make them attain superior performances over the existing methods in several benchmark datasets. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_14444 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Fake It till You Make It: Curricular Dynamic Forgery Augmentations towards General Deepfake Detection Lin, Yuzhen Song, Wentang Li, Bin Li, Yuezun Ni, Jiangqun Chen, Han Li, Qiushi Computer Vision and Pattern Recognition Previous studies in deepfake detection have shown promising results when testing face forgeries from the same dataset as the training. However, the problem remains challenging when one tries to generalize the detector to forgeries from unseen datasets and created by unseen methods. In this work, we present a novel general deepfake detection method, called \textbf{C}urricular \textbf{D}ynamic \textbf{F}orgery \textbf{A}ugmentation (CDFA), which jointly trains a deepfake detector with a forgery augmentation policy network. Unlike the previous works, we propose to progressively apply forgery augmentations following a monotonic curriculum during the training. We further propose a dynamic forgery searching strategy to select one suitable forgery augmentation operation for each image varying between training stages, producing a forgery augmentation policy optimized for better generalization. In addition, we propose a novel forgery augmentation named self-shifted blending image to simply imitate the temporal inconsistency of deepfake generation. Comprehensive experiments show that CDFA can significantly improve both cross-datasets and cross-manipulations performances of various naive deepfake detectors in a plug-and-play way, and make them attain superior performances over the existing methods in several benchmark datasets. |
| title | Fake It till You Make It: Curricular Dynamic Forgery Augmentations towards General Deepfake Detection |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2409.14444 |