Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2504.12423 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914552837308416 |
|---|---|
| author | Shi, Haohan Shi, Xiyu Dogan, Safak Alzubi, Saif Huang, Tianjin Zhang, Yunxiao |
| author_facet | Shi, Haohan Shi, Xiyu Dogan, Safak Alzubi, Saif Huang, Tianjin Zhang, Yunxiao |
| contents | Existing Audio Deepfake Detection (ADD) systems often struggle to generalise effectively due to the significantly degraded audio quality caused by audio codec compression and channel transmission effects in real-world communication scenarios. To address this challenge, we developed a rigorous benchmark to evaluate the performance of the ADD system under such scenarios. We introduced ADD-C, a new test dataset to evaluate the robustness of ADD systems under diverse communication conditions, including different combinations of audio codecs for compression and packet loss rates. Benchmarking three baseline ADD models on the ADD-C dataset demonstrated a significant decline in robustness under such conditions. A novel Data Augmentation (DA) strategy was proposed to improve the robustness of ADD systems. Experimental results demonstrated that the proposed approach significantly enhances the performance of ADD systems on the proposed ADD-C dataset. Our benchmark can assist future efforts towards building practical and robustly generalisable ADD systems. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_12423 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Benchmarking Audio Deepfake Detection Robustness in Real-world Communication Scenarios Shi, Haohan Shi, Xiyu Dogan, Safak Alzubi, Saif Huang, Tianjin Zhang, Yunxiao Audio and Speech Processing Signal Processing Existing Audio Deepfake Detection (ADD) systems often struggle to generalise effectively due to the significantly degraded audio quality caused by audio codec compression and channel transmission effects in real-world communication scenarios. To address this challenge, we developed a rigorous benchmark to evaluate the performance of the ADD system under such scenarios. We introduced ADD-C, a new test dataset to evaluate the robustness of ADD systems under diverse communication conditions, including different combinations of audio codecs for compression and packet loss rates. Benchmarking three baseline ADD models on the ADD-C dataset demonstrated a significant decline in robustness under such conditions. A novel Data Augmentation (DA) strategy was proposed to improve the robustness of ADD systems. Experimental results demonstrated that the proposed approach significantly enhances the performance of ADD systems on the proposed ADD-C dataset. Our benchmark can assist future efforts towards building practical and robustly generalisable ADD systems. |
| title | Benchmarking Audio Deepfake Detection Robustness in Real-world Communication Scenarios |
| topic | Audio and Speech Processing Signal Processing |
| url | https://arxiv.org/abs/2504.12423 |