Robust Training of Singing Voice Synthesis Using Prior and Posterior Uncertainty
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917149127213056 |
|---|---|
| author | Zhao, Yiwen Shi, Jiatong Tang, Yuxun Chen, William Watanabe, Shinji |
| author_facet | Zhao, Yiwen Shi, Jiatong Tang, Yuxun Chen, William Watanabe, Shinji |
| contents | Singing voice synthesis (SVS) has seen remarkable advancements in recent years. However, compared to speech and general audio data, publicly available singing datasets remain limited. In practice, this data scarcity often leads to performance degradation in long-tail scenarios, such as imbalanced pitch distributions or rare singing styles. To mitigate these challenges, we propose uncertainty-based optimization to improve the training process of end-to-end SVS models. First, we introduce differentiable data augmentation in the adversarial training, which operates in a sample-wise manner to increase the prior uncertainty. Second, we incorporate a frame-level uncertainty prediction module that estimates the posterior uncertainty, enabling the model to allocate more learning capacity to low-confidence segments. Empirical results on the Opencpop and Ofuton-P, across Chinese and Japanese, demonstrate that our approach improves performance in various perspectives. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2512_14653 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Robust Training of Singing Voice Synthesis Using Prior and Posterior Uncertainty Zhao, Yiwen Shi, Jiatong Tang, Yuxun Chen, William Watanabe, Shinji Sound Singing voice synthesis (SVS) has seen remarkable advancements in recent years. However, compared to speech and general audio data, publicly available singing datasets remain limited. In practice, this data scarcity often leads to performance degradation in long-tail scenarios, such as imbalanced pitch distributions or rare singing styles. To mitigate these challenges, we propose uncertainty-based optimization to improve the training process of end-to-end SVS models. First, we introduce differentiable data augmentation in the adversarial training, which operates in a sample-wise manner to increase the prior uncertainty. Second, we incorporate a frame-level uncertainty prediction module that estimates the posterior uncertainty, enabling the model to allocate more learning capacity to low-confidence segments. Empirical results on the Opencpop and Ofuton-P, across Chinese and Japanese, demonstrate that our approach improves performance in various perspectives. |
| title | Robust Training of Singing Voice Synthesis Using Prior and Posterior Uncertainty |
| topic | Sound |
| url | https://arxiv.org/abs/2512.14653 |