Residual Speaker Representation for One-Shot Voice Conversion
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909283163045888 |
|---|---|
| author | Xu, Le Yi, Jiangyan Wang, Tao Ren, Yong Zhong, Rongxiu Wen, Zhengqi Tao, Jianhua |
| author_facet | Xu, Le Yi, Jiangyan Wang, Tao Ren, Yong Zhong, Rongxiu Wen, Zhengqi Tao, Jianhua |
| contents | Recently, there have been significant advancements in voice conversion, resulting in high-quality performance. However, there are still two critical challenges in this field. Firstly, current voice conversion methods have limited robustness when encountering unseen speakers. Secondly, they also have limited ability to control timbre representation. To address these challenges, this paper presents a novel approach that leverages tokens of multi-layer residual approximations to enhance robustness when dealing with unseen speakers, called the residual speaker module. Introducing multi-layer approximations facilitates the separation of information from the timbre, enabling effective control over timbre in voice conversion. The proposed method outperforms baselines in subjective and objective evaluations, demonstrating superior performance and increased robustness. Our demo page is publicly available. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2309_08166 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Residual Speaker Representation for One-Shot Voice Conversion Xu, Le Yi, Jiangyan Wang, Tao Ren, Yong Zhong, Rongxiu Wen, Zhengqi Tao, Jianhua Sound Audio and Speech Processing Recently, there have been significant advancements in voice conversion, resulting in high-quality performance. However, there are still two critical challenges in this field. Firstly, current voice conversion methods have limited robustness when encountering unseen speakers. Secondly, they also have limited ability to control timbre representation. To address these challenges, this paper presents a novel approach that leverages tokens of multi-layer residual approximations to enhance robustness when dealing with unseen speakers, called the residual speaker module. Introducing multi-layer approximations facilitates the separation of information from the timbre, enabling effective control over timbre in voice conversion. The proposed method outperforms baselines in subjective and objective evaluations, demonstrating superior performance and increased robustness. Our demo page is publicly available. |
| title | Residual Speaker Representation for One-Shot Voice Conversion |
| topic | Sound Audio and Speech Processing |
| url | https://arxiv.org/abs/2309.08166 |