QualiSpeech: A Speech Quality Assessment Dataset with Natural Language Reasoning and Descriptions
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866918059788206080 |
|---|---|
| author | Wang, Siyin Yu, Wenyi Chen, Xianzhao Tian, Xiaohai Zhang, Jun Lu, Lu Tsao, Yu Yamagishi, Junichi Wang, Yuxuan Zhang, Chao |
| author_facet | Wang, Siyin Yu, Wenyi Chen, Xianzhao Tian, Xiaohai Zhang, Jun Lu, Lu Tsao, Yu Yamagishi, Junichi Wang, Yuxuan Zhang, Chao |
| contents | This paper explores a novel perspective to speech quality assessment by leveraging natural language descriptions, offering richer, more nuanced insights than traditional numerical scoring methods. Natural language feedback provides instructive recommendations and detailed evaluations, yet existing datasets lack the comprehensive annotations needed for this approach. To bridge this gap, we introduce QualiSpeech, a comprehensive low-level speech quality assessment dataset encompassing 11 key aspects and detailed natural language comments that include reasoning and contextual insights. Additionally, we propose the QualiSpeech Benchmark to evaluate the low-level speech understanding capabilities of auditory large language models (LLMs). Experimental results demonstrate that finetuned auditory LLMs can reliably generate detailed descriptions of noise and distortion, effectively identifying their types and temporal characteristics. The results further highlight the potential for incorporating reasoning to enhance the accuracy and reliability of quality assessments. The dataset will be released at https://huggingface.co/datasets/tsinghua-ee/QualiSpeech. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_20290 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | QualiSpeech: A Speech Quality Assessment Dataset with Natural Language Reasoning and Descriptions Wang, Siyin Yu, Wenyi Chen, Xianzhao Tian, Xiaohai Zhang, Jun Lu, Lu Tsao, Yu Yamagishi, Junichi Wang, Yuxuan Zhang, Chao Audio and Speech Processing Artificial Intelligence Computation and Language Sound This paper explores a novel perspective to speech quality assessment by leveraging natural language descriptions, offering richer, more nuanced insights than traditional numerical scoring methods. Natural language feedback provides instructive recommendations and detailed evaluations, yet existing datasets lack the comprehensive annotations needed for this approach. To bridge this gap, we introduce QualiSpeech, a comprehensive low-level speech quality assessment dataset encompassing 11 key aspects and detailed natural language comments that include reasoning and contextual insights. Additionally, we propose the QualiSpeech Benchmark to evaluate the low-level speech understanding capabilities of auditory large language models (LLMs). Experimental results demonstrate that finetuned auditory LLMs can reliably generate detailed descriptions of noise and distortion, effectively identifying their types and temporal characteristics. The results further highlight the potential for incorporating reasoning to enhance the accuracy and reliability of quality assessments. The dataset will be released at https://huggingface.co/datasets/tsinghua-ee/QualiSpeech. |
| title | QualiSpeech: A Speech Quality Assessment Dataset with Natural Language Reasoning and Descriptions |
| topic | Audio and Speech Processing Artificial Intelligence Computation and Language Sound |
| url | https://arxiv.org/abs/2503.20290 |