A Brief Review for Compression and Transfer Learning Techniques in DeepFake Detection
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866909597515644928 |
|---|---|
| author | Karathanasis, Andreas Violos, John Kompatsiaris, Ioannis Papadopoulos, Symeon |
| author_facet | Karathanasis, Andreas Violos, John Kompatsiaris, Ioannis Papadopoulos, Symeon |
| contents | Training and deploying deepfake detection models on edge devices offers the advantage of maintaining data privacy and confidentiality by processing it close to its source. However, this approach is constrained by the limited computational and memory resources available at the edge. To address this challenge, we explore compression techniques to reduce computational demands and inference time, alongside transfer learning methods to minimize training overhead. Using the Synthbuster, RAISE, and ForenSynths datasets, we evaluate the effectiveness of pruning, knowledge distillation (KD), quantization, fine-tuning, and adapter-based techniques. Our experimental results demonstrate that both compression and transfer learning can be effectively achieved, even with a high compression level of 90%, remaining at the same performance level when the training and validation data originate from the same DeepFake model. However, when the testing dataset is generated by DeepFake models not present in the training set, a domain generalization issue becomes evident. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_21066 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | A Brief Review for Compression and Transfer Learning Techniques in DeepFake Detection Karathanasis, Andreas Violos, John Kompatsiaris, Ioannis Papadopoulos, Symeon Machine Learning Artificial Intelligence Training and deploying deepfake detection models on edge devices offers the advantage of maintaining data privacy and confidentiality by processing it close to its source. However, this approach is constrained by the limited computational and memory resources available at the edge. To address this challenge, we explore compression techniques to reduce computational demands and inference time, alongside transfer learning methods to minimize training overhead. Using the Synthbuster, RAISE, and ForenSynths datasets, we evaluate the effectiveness of pruning, knowledge distillation (KD), quantization, fine-tuning, and adapter-based techniques. Our experimental results demonstrate that both compression and transfer learning can be effectively achieved, even with a high compression level of 90%, remaining at the same performance level when the training and validation data originate from the same DeepFake model. However, when the testing dataset is generated by DeepFake models not present in the training set, a domain generalization issue becomes evident. |
| title | A Brief Review for Compression and Transfer Learning Techniques in DeepFake Detection |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2504.21066 |