Improving Voice Quality in Speech Anonymization With Just Perception-Informed Losses
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866910657999273984 |
|---|---|
| author | Ghosh, Suhita Thiele, Tim Lorbeer, Frederic Dreyer, Frank Stober, Sebastian |
| author_facet | Ghosh, Suhita Thiele, Tim Lorbeer, Frederic Dreyer, Frank Stober, Sebastian |
| contents | The increasing use of cloud-based speech assistants has heightened the need for effective speech anonymization, which aims to obscure a speaker's identity while retaining critical information for subsequent tasks. One approach to achieving this is through voice conversion. While existing methods often emphasize complex architectures and training techniques, our research underscores the importance of loss functions inspired by the human auditory system. Our proposed loss functions are model-agnostic, incorporating handcrafted and deep learning-based features to effectively capture quality representations. Through objective and subjective evaluations, we demonstrate that a VQVAE-based model, enhanced with our perception-driven losses, surpasses the vanilla model in terms of naturalness, intelligibility, and prosody while maintaining speaker anonymity. These improvements are consistently observed across various datasets, languages, target speakers, and genders. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_15499 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Improving Voice Quality in Speech Anonymization With Just Perception-Informed Losses Ghosh, Suhita Thiele, Tim Lorbeer, Frederic Dreyer, Frank Stober, Sebastian Artificial Intelligence Sound Audio and Speech Processing The increasing use of cloud-based speech assistants has heightened the need for effective speech anonymization, which aims to obscure a speaker's identity while retaining critical information for subsequent tasks. One approach to achieving this is through voice conversion. While existing methods often emphasize complex architectures and training techniques, our research underscores the importance of loss functions inspired by the human auditory system. Our proposed loss functions are model-agnostic, incorporating handcrafted and deep learning-based features to effectively capture quality representations. Through objective and subjective evaluations, we demonstrate that a VQVAE-based model, enhanced with our perception-driven losses, surpasses the vanilla model in terms of naturalness, intelligibility, and prosody while maintaining speaker anonymity. These improvements are consistently observed across various datasets, languages, target speakers, and genders. |
| title | Improving Voice Quality in Speech Anonymization With Just Perception-Informed Losses |
| topic | Artificial Intelligence Sound Audio and Speech Processing |
| url | https://arxiv.org/abs/2410.15499 |