Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2504.05833 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910906384908288 |
|---|---|
| author | Wang, Wenyu Zhou, Yiquan Zhu, Jihua Ding, Hongwu Xu, Jiacheng Li, Shihao |
| author_facet | Wang, Wenyu Zhou, Yiquan Zhu, Jihua Ding, Hongwu Xu, Jiacheng Li, Shihao |
| contents | Voice conversion (VC) has made progress in feature disentanglement, but it is still difficult to balance timbre and content information. This paper evaluates the pre-trained model features commonly used in voice conversion, and proposes an innovative method for disentangling speech feature representations. Specifically, we first propose an ideal content feature, referred to as the average feature, which is calculated by averaging the features within frame-level aligned parallel speech (FAPS) data. For generating FAPS data, we utilize a technique that involves freezing the duration predictor in a Text-to-Speech system and manipulating speaker embedding. To fit the average feature on traditional VC datasets, we then design the AVENet to take features as input and generate closely matching average features. Experiments are conducted on the performance of AVENet-extracted features within a VC system. The experimental results demonstrate its superiority over multiple current speech feature disentangling methods. These findings affirm the effectiveness of our disentanglement approach. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_05833 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | AVENet: Disentangling Features by Approximating Average Features for Voice Conversion Wang, Wenyu Zhou, Yiquan Zhu, Jihua Ding, Hongwu Xu, Jiacheng Li, Shihao Sound Voice conversion (VC) has made progress in feature disentanglement, but it is still difficult to balance timbre and content information. This paper evaluates the pre-trained model features commonly used in voice conversion, and proposes an innovative method for disentangling speech feature representations. Specifically, we first propose an ideal content feature, referred to as the average feature, which is calculated by averaging the features within frame-level aligned parallel speech (FAPS) data. For generating FAPS data, we utilize a technique that involves freezing the duration predictor in a Text-to-Speech system and manipulating speaker embedding. To fit the average feature on traditional VC datasets, we then design the AVENet to take features as input and generate closely matching average features. Experiments are conducted on the performance of AVENet-extracted features within a VC system. The experimental results demonstrate its superiority over multiple current speech feature disentangling methods. These findings affirm the effectiveness of our disentanglement approach. |
| title | AVENet: Disentangling Features by Approximating Average Features for Voice Conversion |
| topic | Sound |
| url | https://arxiv.org/abs/2504.05833 |