Gespeichert in:
| Hauptverfasser: | , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | https://arxiv.org/abs/2412.20801 |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866909444041867264 |
|---|---|
| author | Si, Xiaotian Li, Linghui Zhang, Liwei Guo, Ziduo Yuan, Kaiguo Li, Bingyu Li, Xiaoyong |
| author_facet | Si, Xiaotian Li, Linghui Zhang, Liwei Guo, Ziduo Yuan, Kaiguo Li, Bingyu Li, Xiaoyong |
| contents | A plethora of face forgery detectors exist to tackle facial deepfake risks. However, their practical application is hindered by the challenge of generalizing to forgeries unseen during the training stage. To this end, we introduce an insertable adaptation module that can adapt a trained off-the-shelf detector using only online unlabeled test data, without requiring modifications to the architecture or training process. Specifically, we first present a learnable class prototype-based classifier that generates predictions from the revised features and prototypes, enabling effective handling of various forgery clues and domain gaps during online testing. Additionally, we propose a nearest feature calibrator to further improve prediction accuracy and reduce the impact of noisy pseudo-labels during self-training. Experiments across multiple datasets show that our module achieves superior generalization compared to state-of-the-art methods. Moreover, it functions as a plug-and-play component that can be combined with various detectors to enhance the overall performance. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_20801 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Generalize Your Face Forgery Detectors: An Insertable Adaptation Module Is All You Need Si, Xiaotian Li, Linghui Zhang, Liwei Guo, Ziduo Yuan, Kaiguo Li, Bingyu Li, Xiaoyong Computer Vision and Pattern Recognition A plethora of face forgery detectors exist to tackle facial deepfake risks. However, their practical application is hindered by the challenge of generalizing to forgeries unseen during the training stage. To this end, we introduce an insertable adaptation module that can adapt a trained off-the-shelf detector using only online unlabeled test data, without requiring modifications to the architecture or training process. Specifically, we first present a learnable class prototype-based classifier that generates predictions from the revised features and prototypes, enabling effective handling of various forgery clues and domain gaps during online testing. Additionally, we propose a nearest feature calibrator to further improve prediction accuracy and reduce the impact of noisy pseudo-labels during self-training. Experiments across multiple datasets show that our module achieves superior generalization compared to state-of-the-art methods. Moreover, it functions as a plug-and-play component that can be combined with various detectors to enhance the overall performance. |
| title | Generalize Your Face Forgery Detectors: An Insertable Adaptation Module Is All You Need |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2412.20801 |