A robust audio deepfake detection system via multi-view feature
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866910353131044864 |
|---|---|
| author | Yang, Yujie Qin, Haochen Zhou, Hang Wang, Chengcheng Guo, Tianyu Han, Kai Wang, Yunhe |
| author_facet | Yang, Yujie Qin, Haochen Zhou, Hang Wang, Chengcheng Guo, Tianyu Han, Kai Wang, Yunhe |
| contents | With the advancement of generative modeling techniques, synthetic human speech becomes increasingly indistinguishable from real, and tricky challenges are elicited for the audio deepfake detection (ADD) system. In this paper, we exploit audio features to improve the generalizability of ADD systems. Investigation of the ADD task performance is conducted over a broad range of audio features, including various handcrafted features and learning-based features. Experiments show that learning-based audio features pretrained on a large amount of data generalize better than hand-crafted features on out-of-domain scenarios. Subsequently, we further improve the generalizability of the ADD system using proposed multi-feature approaches to incorporate complimentary information from features of different views. The model trained on ASV2019 data achieves an equal error rate of 24.27\% on the In-the-Wild dataset. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_01960 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | A robust audio deepfake detection system via multi-view feature Yang, Yujie Qin, Haochen Zhou, Hang Wang, Chengcheng Guo, Tianyu Han, Kai Wang, Yunhe Sound Audio and Speech Processing With the advancement of generative modeling techniques, synthetic human speech becomes increasingly indistinguishable from real, and tricky challenges are elicited for the audio deepfake detection (ADD) system. In this paper, we exploit audio features to improve the generalizability of ADD systems. Investigation of the ADD task performance is conducted over a broad range of audio features, including various handcrafted features and learning-based features. Experiments show that learning-based audio features pretrained on a large amount of data generalize better than hand-crafted features on out-of-domain scenarios. Subsequently, we further improve the generalizability of the ADD system using proposed multi-feature approaches to incorporate complimentary information from features of different views. The model trained on ASV2019 data achieves an equal error rate of 24.27\% on the In-the-Wild dataset. |
| title | A robust audio deepfake detection system via multi-view feature |
| topic | Sound Audio and Speech Processing |
| url | https://arxiv.org/abs/2403.01960 |