Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2512.11241 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917294248034304 |
|---|---|
| author | Li, Yupei Lyu, Chenyang Wang, Longyue Luo, Weihua Zhang, Kaifu Schuller, Björn W. |
| author_facet | Li, Yupei Lyu, Chenyang Wang, Longyue Luo, Weihua Zhang, Kaifu Schuller, Björn W. |
| contents | Speech deepfake detection (DFD) has benefited from diverse acoustic and semantic speech representations, many of which encode valuable speech information and are costly to train. Existing approaches typically enhance DFD by tuning the representations or applying post-hoc classification on frozen features, limiting control over improving discriminative DF cues without distorting original semantics. We find that emotion is encoded across diverse speech features and correlates with DFD. Therefore, we introduce a unified, feature-agnostic, and non-destructive training framework that uses emotion as a bridging constraint to guide speech features toward DFD, treating emotion recognition as a representation alignment objective rather than an auxiliary task, while preserving the original semantic information. Experiments on FakeOrReal and IntheWild show accuracy improvements of up to 6\% and 2\%, respectively, with corresponding reductions in equal error rate. Code is in the supplementary material. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2512_11241 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | The Affective Bridge: Preserving Speech Representations while Enhancing Deepfake Detection vian emotional Constraints Li, Yupei Lyu, Chenyang Wang, Longyue Luo, Weihua Zhang, Kaifu Schuller, Björn W. Sound Speech deepfake detection (DFD) has benefited from diverse acoustic and semantic speech representations, many of which encode valuable speech information and are costly to train. Existing approaches typically enhance DFD by tuning the representations or applying post-hoc classification on frozen features, limiting control over improving discriminative DF cues without distorting original semantics. We find that emotion is encoded across diverse speech features and correlates with DFD. Therefore, we introduce a unified, feature-agnostic, and non-destructive training framework that uses emotion as a bridging constraint to guide speech features toward DFD, treating emotion recognition as a representation alignment objective rather than an auxiliary task, while preserving the original semantic information. Experiments on FakeOrReal and IntheWild show accuracy improvements of up to 6\% and 2\%, respectively, with corresponding reductions in equal error rate. Code is in the supplementary material. |
| title | The Affective Bridge: Preserving Speech Representations while Enhancing Deepfake Detection vian emotional Constraints |
| topic | Sound |
| url | https://arxiv.org/abs/2512.11241 |