NPU-NTU System for Voice Privacy 2024 Challenge
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910812904357888 |
|---|---|
| author | Yao, Jixun Kuzmin, Nikita Wang, Qing Guo, Pengcheng Ning, Ziqian Guo, Dake Lee, Kong Aik Chng, Eng-Siong Xie, Lei |
| author_facet | Yao, Jixun Kuzmin, Nikita Wang, Qing Guo, Pengcheng Ning, Ziqian Guo, Dake Lee, Kong Aik Chng, Eng-Siong Xie, Lei |
| contents | Speaker anonymization is an effective privacy protection solution that conceals the speaker's identity while preserving the linguistic content and paralinguistic information of the original speech. To establish a fair benchmark and facilitate comparison of speaker anonymization systems, the VoicePrivacy Challenge (VPC) was held in 2020 and 2022, with a new edition planned for 2024. In this paper, we describe our proposed speaker anonymization system for VPC 2024. Our system employs a disentangled neural codec architecture and a serial disentanglement strategy to gradually disentangle the global speaker identity and time-variant linguistic content and paralinguistic information. We introduce multiple distillation methods to disentangle linguistic content, speaker identity, and emotion. These methods include semantic distillation, supervised speaker distillation, and frame-level emotion distillation. Based on these distillations, we anonymize the original speaker identity using a weighted sum of a set of candidate speaker identities and a randomly generated speaker identity. Our system achieves the best trade-off of privacy protection and emotion preservation in VPC 2024. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_04173 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | NPU-NTU System for Voice Privacy 2024 Challenge Yao, Jixun Kuzmin, Nikita Wang, Qing Guo, Pengcheng Ning, Ziqian Guo, Dake Lee, Kong Aik Chng, Eng-Siong Xie, Lei Audio and Speech Processing Speaker anonymization is an effective privacy protection solution that conceals the speaker's identity while preserving the linguistic content and paralinguistic information of the original speech. To establish a fair benchmark and facilitate comparison of speaker anonymization systems, the VoicePrivacy Challenge (VPC) was held in 2020 and 2022, with a new edition planned for 2024. In this paper, we describe our proposed speaker anonymization system for VPC 2024. Our system employs a disentangled neural codec architecture and a serial disentanglement strategy to gradually disentangle the global speaker identity and time-variant linguistic content and paralinguistic information. We introduce multiple distillation methods to disentangle linguistic content, speaker identity, and emotion. These methods include semantic distillation, supervised speaker distillation, and frame-level emotion distillation. Based on these distillations, we anonymize the original speaker identity using a weighted sum of a set of candidate speaker identities and a randomly generated speaker identity. Our system achieves the best trade-off of privacy protection and emotion preservation in VPC 2024. |
| title | NPU-NTU System for Voice Privacy 2024 Challenge |
| topic | Audio and Speech Processing |
| url | https://arxiv.org/abs/2409.04173 |