The Interspeech 2024 Challenge on Speech Processing Using Discrete Units
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866914832309026816 |
|---|---|
| author | Chang, Xuankai Shi, Jiatong Tian, Jinchuan Wu, Yuning Tang, Yuxun Wu, Yihan Watanabe, Shinji Adi, Yossi Chen, Xie Jin, Qin |
| author_facet | Chang, Xuankai Shi, Jiatong Tian, Jinchuan Wu, Yuning Tang, Yuxun Wu, Yihan Watanabe, Shinji Adi, Yossi Chen, Xie Jin, Qin |
| contents | Representing speech and audio signals in discrete units has become a compelling alternative to traditional high-dimensional feature vectors. Numerous studies have highlighted the efficacy of discrete units in various applications such as speech compression and restoration, speech recognition, and speech generation. To foster exploration in this domain, we introduce the Interspeech 2024 Challenge, which focuses on new speech processing benchmarks using discrete units. It encompasses three pivotal tasks, namely multilingual automatic speech recognition, text-to-speech, and singing voice synthesis, and aims to assess the potential applicability of discrete units in these tasks. This paper outlines the challenge designs and baseline descriptions. We also collate baseline and selected submission systems, along with preliminary findings, offering valuable contributions to future research in this evolving field. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_07725 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | The Interspeech 2024 Challenge on Speech Processing Using Discrete Units Chang, Xuankai Shi, Jiatong Tian, Jinchuan Wu, Yuning Tang, Yuxun Wu, Yihan Watanabe, Shinji Adi, Yossi Chen, Xie Jin, Qin Sound Audio and Speech Processing Representing speech and audio signals in discrete units has become a compelling alternative to traditional high-dimensional feature vectors. Numerous studies have highlighted the efficacy of discrete units in various applications such as speech compression and restoration, speech recognition, and speech generation. To foster exploration in this domain, we introduce the Interspeech 2024 Challenge, which focuses on new speech processing benchmarks using discrete units. It encompasses three pivotal tasks, namely multilingual automatic speech recognition, text-to-speech, and singing voice synthesis, and aims to assess the potential applicability of discrete units in these tasks. This paper outlines the challenge designs and baseline descriptions. We also collate baseline and selected submission systems, along with preliminary findings, offering valuable contributions to future research in this evolving field. |
| title | The Interspeech 2024 Challenge on Speech Processing Using Discrete Units |
| topic | Sound Audio and Speech Processing |
| url | https://arxiv.org/abs/2406.07725 |