Comparing Unsupervised and Supervised Semantic Speech Tokens: A Case Study of Child ASR
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866917121311637504 |
|---|---|
| author | Shi, Mohan Shankar, Natarajan Balaji Zhang, Kaiyuan Wang, Zilai Alwan, Abeer |
| author_facet | Shi, Mohan Shankar, Natarajan Balaji Zhang, Kaiyuan Wang, Zilai Alwan, Abeer |
| contents | Discrete speech tokens have gained attention for their storage efficiency and integration with Large Language Models (LLMs). They are commonly categorized into acoustic and semantic tokens, with the latter being more advantageous for Automatic Speech Recognition (ASR). Traditionally, unsupervised K-means clustering has been used to extract semantic speech tokens from Speech Foundation Models (SFMs). Recently, supervised methods, such as finite scalar quantization (FSQ) trained with ASR loss, have emerged for speech generation. Both approaches leverage pre-trained SFMs, benefiting low-resource tasks such as child ASR.
This paper systematically compares supervised and unsupervised semantic speech tokens for child ASR. Results show that supervised methods not only outperform unsupervised ones but even unexpectedly surpass continuous representations, and they perform well even in ultra-low bitrate settings. These findings highlight the advantages of supervised semantic tokens and offer insights for improving discrete speech tokenization. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2512_03301 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Comparing Unsupervised and Supervised Semantic Speech Tokens: A Case Study of Child ASR Shi, Mohan Shankar, Natarajan Balaji Zhang, Kaiyuan Wang, Zilai Alwan, Abeer Audio and Speech Processing Discrete speech tokens have gained attention for their storage efficiency and integration with Large Language Models (LLMs). They are commonly categorized into acoustic and semantic tokens, with the latter being more advantageous for Automatic Speech Recognition (ASR). Traditionally, unsupervised K-means clustering has been used to extract semantic speech tokens from Speech Foundation Models (SFMs). Recently, supervised methods, such as finite scalar quantization (FSQ) trained with ASR loss, have emerged for speech generation. Both approaches leverage pre-trained SFMs, benefiting low-resource tasks such as child ASR. This paper systematically compares supervised and unsupervised semantic speech tokens for child ASR. Results show that supervised methods not only outperform unsupervised ones but even unexpectedly surpass continuous representations, and they perform well even in ultra-low bitrate settings. These findings highlight the advantages of supervised semantic tokens and offer insights for improving discrete speech tokenization. |
| title | Comparing Unsupervised and Supervised Semantic Speech Tokens: A Case Study of Child ASR |
| topic | Audio and Speech Processing |
| url | https://arxiv.org/abs/2512.03301 |