Transformers in Speech Processing: A Survey
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916776269316096 |
|---|---|
| author | Latif, Siddique Zaidi, Aun Cuayahuitl, Heriberto Shamshad, Fahad Shoukat, Moazzam Usama, Muhammad Qadir, Junaid |
| author_facet | Latif, Siddique Zaidi, Aun Cuayahuitl, Heriberto Shamshad, Fahad Shoukat, Moazzam Usama, Muhammad Qadir, Junaid |
| contents | The remarkable success of transformers in the field of natural language processing has sparked the interest of the speech-processing community, leading to an exploration of their potential for modeling long-range dependencies within speech sequences. Recently, transformers have gained prominence across various speech-related domains, including automatic speech recognition, speech synthesis, speech translation, speech para-linguistics, speech enhancement, spoken dialogue systems, and numerous multimodal applications. In this paper, we present a comprehensive survey that aims to bridge research studies from diverse subfields within speech technology. By consolidating findings from across the speech technology landscape, we provide a valuable resource for researchers interested in harnessing the power of transformers to advance the field. We identify the challenges encountered by transformers in speech processing while also offering insights into potential solutions to address these issues. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2303_11607 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Transformers in Speech Processing: A Survey Latif, Siddique Zaidi, Aun Cuayahuitl, Heriberto Shamshad, Fahad Shoukat, Moazzam Usama, Muhammad Qadir, Junaid Computation and Language Sound Audio and Speech Processing The remarkable success of transformers in the field of natural language processing has sparked the interest of the speech-processing community, leading to an exploration of their potential for modeling long-range dependencies within speech sequences. Recently, transformers have gained prominence across various speech-related domains, including automatic speech recognition, speech synthesis, speech translation, speech para-linguistics, speech enhancement, spoken dialogue systems, and numerous multimodal applications. In this paper, we present a comprehensive survey that aims to bridge research studies from diverse subfields within speech technology. By consolidating findings from across the speech technology landscape, we provide a valuable resource for researchers interested in harnessing the power of transformers to advance the field. We identify the challenges encountered by transformers in speech processing while also offering insights into potential solutions to address these issues. |
| title | Transformers in Speech Processing: A Survey |
| topic | Computation and Language Sound Audio and Speech Processing |
| url | https://arxiv.org/abs/2303.11607 |