On The Landscape of Spoken Language Models: A Comprehensive Survey
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866913008421175296 |
|---|---|
| author | Arora, Siddhant Chang, Kai-Wei Chien, Chung-Ming Peng, Yifan Wu, Haibin Adi, Yossi Dupoux, Emmanuel Lee, Hung-Yi Livescu, Karen Watanabe, Shinji |
| author_facet | Arora, Siddhant Chang, Kai-Wei Chien, Chung-Ming Peng, Yifan Wu, Haibin Adi, Yossi Dupoux, Emmanuel Lee, Hung-Yi Livescu, Karen Watanabe, Shinji |
| contents | The field of spoken language processing is undergoing a shift from training custom-built, task-specific models toward using and optimizing spoken language models (SLMs) which act as universal speech processing systems. This trend is similar to the progression toward universal language models that has taken place in the field of (text) natural language processing. SLMs include both "pure" language models of speech -- models of the distribution of tokenized speech sequences -- and models that combine speech encoders with text language models, often including both spoken and written input or output. Work in this area is very diverse, with a range of terminology and evaluation settings. This paper aims to contribute an improved understanding of SLMs via a unifying literature survey of recent work in the context of the evolution of the field. Our survey categorizes the work in this area by model architecture, training, and evaluation choices, and describes some key challenges and directions for future work. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_08528 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | On The Landscape of Spoken Language Models: A Comprehensive Survey Arora, Siddhant Chang, Kai-Wei Chien, Chung-Ming Peng, Yifan Wu, Haibin Adi, Yossi Dupoux, Emmanuel Lee, Hung-Yi Livescu, Karen Watanabe, Shinji Computation and Language Sound Audio and Speech Processing The field of spoken language processing is undergoing a shift from training custom-built, task-specific models toward using and optimizing spoken language models (SLMs) which act as universal speech processing systems. This trend is similar to the progression toward universal language models that has taken place in the field of (text) natural language processing. SLMs include both "pure" language models of speech -- models of the distribution of tokenized speech sequences -- and models that combine speech encoders with text language models, often including both spoken and written input or output. Work in this area is very diverse, with a range of terminology and evaluation settings. This paper aims to contribute an improved understanding of SLMs via a unifying literature survey of recent work in the context of the evolution of the field. Our survey categorizes the work in this area by model architecture, training, and evaluation choices, and describes some key challenges and directions for future work. |
| title | On The Landscape of Spoken Language Models: A Comprehensive Survey |
| topic | Computation and Language Sound Audio and Speech Processing |
| url | https://arxiv.org/abs/2504.08528 |