WenetSpeech-Yue: A Large-scale Cantonese Speech Corpus with Multi-dimensional Annotation
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866908519801815040 |
|---|---|
| author | Li, Longhao Guo, Zhao Chen, Hongjie Dai, Yuhang Zhang, Ziyu Xue, Hongfei Zuo, Tianlun Wang, Chengyou Wang, Shuiyuan Li, Jie Kang, Jian Xu, Xin Bu, Hui Zhang, Binbin Yuan, Ruibin Zhou, Ziya Xue, Wei Xie, Lei |
| author_facet | Li, Longhao Guo, Zhao Chen, Hongjie Dai, Yuhang Zhang, Ziyu Xue, Hongfei Zuo, Tianlun Wang, Chengyou Wang, Shuiyuan Li, Jie Kang, Jian Xu, Xin Bu, Hui Zhang, Binbin Yuan, Ruibin Zhou, Ziya Xue, Wei Xie, Lei |
| contents | The development of speech understanding and generation has been significantly accelerated by the availability of large-scale, high-quality speech datasets. Among these, ASR and TTS are regarded as the most established and fundamental tasks. However, for Cantonese (Yue Chinese), spoken by approximately 84.9 million native speakers worldwide, limited annotated resources have hindered progress and resulted in suboptimal ASR and TTS performance. To address this challenge, we propose WenetSpeech-Pipe, an integrated pipeline for building large-scale speech corpus with multi-dimensional annotation tailored for speech understanding and generation. It comprises six modules: Audio Collection, Speaker Attributes Annotation, Speech Quality Annotation, Automatic Speech Recognition, Text Postprocessing and Recognizer Output Voting, enabling rich and high-quality annotations. Based on this pipeline, we release WenetSpeech-Yue, the first large-scale Cantonese speech corpus with multi-dimensional annotation for ASR and TTS, covering 21,800 hours across 10 domains with annotations including ASR transcription, text confidence, speaker identity, age, gender, speech quality scores, among other annotations. We also release WSYue-eval, a comprehensive Cantonese benchmark with two components: WSYue-ASR-eval, a manually annotated set for evaluating ASR on short and long utterances, code-switching, and diverse acoustic conditions, and WSYue-TTS-eval, with base and coverage subsets for standard and generalization testing. Experimental results show that models trained on WenetSpeech-Yue achieve competitive results against state-of-the-art (SOTA) Cantonese ASR and TTS systems, including commercial and LLM-based models, highlighting the value of our dataset and pipeline. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_03959 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | WenetSpeech-Yue: A Large-scale Cantonese Speech Corpus with Multi-dimensional Annotation Li, Longhao Guo, Zhao Chen, Hongjie Dai, Yuhang Zhang, Ziyu Xue, Hongfei Zuo, Tianlun Wang, Chengyou Wang, Shuiyuan Li, Jie Kang, Jian Xu, Xin Bu, Hui Zhang, Binbin Yuan, Ruibin Zhou, Ziya Xue, Wei Xie, Lei Sound The development of speech understanding and generation has been significantly accelerated by the availability of large-scale, high-quality speech datasets. Among these, ASR and TTS are regarded as the most established and fundamental tasks. However, for Cantonese (Yue Chinese), spoken by approximately 84.9 million native speakers worldwide, limited annotated resources have hindered progress and resulted in suboptimal ASR and TTS performance. To address this challenge, we propose WenetSpeech-Pipe, an integrated pipeline for building large-scale speech corpus with multi-dimensional annotation tailored for speech understanding and generation. It comprises six modules: Audio Collection, Speaker Attributes Annotation, Speech Quality Annotation, Automatic Speech Recognition, Text Postprocessing and Recognizer Output Voting, enabling rich and high-quality annotations. Based on this pipeline, we release WenetSpeech-Yue, the first large-scale Cantonese speech corpus with multi-dimensional annotation for ASR and TTS, covering 21,800 hours across 10 domains with annotations including ASR transcription, text confidence, speaker identity, age, gender, speech quality scores, among other annotations. We also release WSYue-eval, a comprehensive Cantonese benchmark with two components: WSYue-ASR-eval, a manually annotated set for evaluating ASR on short and long utterances, code-switching, and diverse acoustic conditions, and WSYue-TTS-eval, with base and coverage subsets for standard and generalization testing. Experimental results show that models trained on WenetSpeech-Yue achieve competitive results against state-of-the-art (SOTA) Cantonese ASR and TTS systems, including commercial and LLM-based models, highlighting the value of our dataset and pipeline. |
| title | WenetSpeech-Yue: A Large-scale Cantonese Speech Corpus with Multi-dimensional Annotation |
| topic | Sound |
| url | https://arxiv.org/abs/2509.03959 |