Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2502.12572 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909585452826624 |
|---|---|
| author | Guo, Wenxiang Zhang, Yu Pan, Changhao Huang, Rongjie Tang, Li Li, Ruiqi Hong, Zhiqing Wang, Yongqi Zhao, Zhou |
| author_facet | Guo, Wenxiang Zhang, Yu Pan, Changhao Huang, Rongjie Tang, Li Li, Ruiqi Hong, Zhiqing Wang, Yongqi Zhao, Zhou |
| contents | Singing voice synthesis has made remarkable progress in generating natural and high-quality voices. However, existing methods rarely provide precise control over vocal techniques such as intensity, mixed voice, falsetto, bubble, and breathy tones, thus limiting the expressive potential of synthetic voices. We introduce TechSinger, an advanced system for controllable singing voice synthesis that supports five languages and seven vocal techniques. TechSinger leverages a flow-matching-based generative model to produce singing voices with enhanced expressive control over various techniques. To enhance the diversity of training data, we develop a technique detection model that automatically annotates datasets with phoneme-level technique labels. Additionally, our prompt-based technique prediction model enables users to specify desired vocal attributes through natural language, offering fine-grained control over the synthesized singing. Experimental results demonstrate that TechSinger significantly enhances the expressiveness and realism of synthetic singing voices, outperforming existing methods in terms of audio quality and technique-specific control. Audio samples can be found at https://gwx314.github.io/tech-singer/. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_12572 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | TechSinger: Technique Controllable Multilingual Singing Voice Synthesis via Flow Matching Guo, Wenxiang Zhang, Yu Pan, Changhao Huang, Rongjie Tang, Li Li, Ruiqi Hong, Zhiqing Wang, Yongqi Zhao, Zhou Sound Singing voice synthesis has made remarkable progress in generating natural and high-quality voices. However, existing methods rarely provide precise control over vocal techniques such as intensity, mixed voice, falsetto, bubble, and breathy tones, thus limiting the expressive potential of synthetic voices. We introduce TechSinger, an advanced system for controllable singing voice synthesis that supports five languages and seven vocal techniques. TechSinger leverages a flow-matching-based generative model to produce singing voices with enhanced expressive control over various techniques. To enhance the diversity of training data, we develop a technique detection model that automatically annotates datasets with phoneme-level technique labels. Additionally, our prompt-based technique prediction model enables users to specify desired vocal attributes through natural language, offering fine-grained control over the synthesized singing. Experimental results demonstrate that TechSinger significantly enhances the expressiveness and realism of synthetic singing voices, outperforming existing methods in terms of audio quality and technique-specific control. Audio samples can be found at https://gwx314.github.io/tech-singer/. |
| title | TechSinger: Technique Controllable Multilingual Singing Voice Synthesis via Flow Matching |
| topic | Sound |
| url | https://arxiv.org/abs/2502.12572 |