WenetSpeech-Wu: Datasets, Benchmarks, and Models for a Unified Chinese Wu Dialect Speech Processing Ecosystem

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wang, Chengyou, Shao, Mingchen, Hu, Jingbin, Zhu, Zeyu, Xue, Hongfei, Mu, Bingshen, Xu, Xin, Duan, Xingyi, Zhang, Binbin, Zhu, Pengcheng, Ding, Chuang, Zhang, Xiaojun, Bu, Hui, Xie, Lei
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917209070108672
author Wang, Chengyou
Shao, Mingchen
Hu, Jingbin
Zhu, Zeyu
Xue, Hongfei
Mu, Bingshen
Xu, Xin
Duan, Xingyi
Zhang, Binbin
Zhu, Pengcheng
Ding, Chuang
Zhang, Xiaojun
Bu, Hui
Xie, Lei
author_facet Wang, Chengyou
Shao, Mingchen
Hu, Jingbin
Zhu, Zeyu
Xue, Hongfei
Mu, Bingshen
Xu, Xin
Duan, Xingyi
Zhang, Binbin
Zhu, Pengcheng
Ding, Chuang
Zhang, Xiaojun
Bu, Hui
Xie, Lei
contents Speech processing for low-resource dialects remains a fundamental challenge in developing inclusive and robust speech technologies. Despite its linguistic significance and large speaker population, the Wu dialect of Chinese has long been hindered by the lack of large-scale speech data, standardized evaluation benchmarks, and publicly available models. In this work, we present WenetSpeech-Wu, the first large-scale, multi-dimensionally annotated open-source speech corpus for the Wu dialect, comprising approximately 8,000 hours of diverse speech data. Building upon this dataset, we introduce WenetSpeech-Wu-Bench, the first standardized and publicly accessible benchmark for systematic evaluation of Wu dialect speech processing, covering automatic speech recognition (ASR), Wu-to-Mandarin translation, speaker attribute prediction, speech emotion recognition, text-to-speech (TTS) synthesis, and instruction-following TTS (instruct TTS). Furthermore, we release a suite of strong open-source models trained on WenetSpeech-Wu, establishing competitive performance across multiple tasks and empirically validating the effectiveness of the proposed dataset. Together, these contributions lay the foundation for a comprehensive Wu dialect speech processing ecosystem, and we open-source proposed datasets, benchmarks, and models to support future research on dialectal speech intelligence.
format Preprint
id arxiv_https___arxiv_org_abs_2601_11027
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle WenetSpeech-Wu: Datasets, Benchmarks, and Models for a Unified Chinese Wu Dialect Speech Processing Ecosystem
Wang, Chengyou
Shao, Mingchen
Hu, Jingbin
Zhu, Zeyu
Xue, Hongfei
Mu, Bingshen
Xu, Xin
Duan, Xingyi
Zhang, Binbin
Zhu, Pengcheng
Ding, Chuang
Zhang, Xiaojun
Bu, Hui
Xie, Lei
Sound
Audio and Speech Processing
Speech processing for low-resource dialects remains a fundamental challenge in developing inclusive and robust speech technologies. Despite its linguistic significance and large speaker population, the Wu dialect of Chinese has long been hindered by the lack of large-scale speech data, standardized evaluation benchmarks, and publicly available models. In this work, we present WenetSpeech-Wu, the first large-scale, multi-dimensionally annotated open-source speech corpus for the Wu dialect, comprising approximately 8,000 hours of diverse speech data. Building upon this dataset, we introduce WenetSpeech-Wu-Bench, the first standardized and publicly accessible benchmark for systematic evaluation of Wu dialect speech processing, covering automatic speech recognition (ASR), Wu-to-Mandarin translation, speaker attribute prediction, speech emotion recognition, text-to-speech (TTS) synthesis, and instruction-following TTS (instruct TTS). Furthermore, we release a suite of strong open-source models trained on WenetSpeech-Wu, establishing competitive performance across multiple tasks and empirically validating the effectiveness of the proposed dataset. Together, these contributions lay the foundation for a comprehensive Wu dialect speech processing ecosystem, and we open-source proposed datasets, benchmarks, and models to support future research on dialectal speech intelligence.
title WenetSpeech-Wu: Datasets, Benchmarks, and Models for a Unified Chinese Wu Dialect Speech Processing Ecosystem
topic Sound
Audio and Speech Processing
url https://arxiv.org/abs/2601.11027