Automatic Speech Recognition with BERT and CTC Transformers: A Review
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916435370967040 |
|---|---|
| author | Djeffal, Noussaiba Kheddar, Hamza Addou, Djamel Mazari, Ahmed Cherif Himeur, Yassine |
| author_facet | Djeffal, Noussaiba Kheddar, Hamza Addou, Djamel Mazari, Ahmed Cherif Himeur, Yassine |
| contents | This review paper provides a comprehensive analysis of recent advances in automatic speech recognition (ASR) with bidirectional encoder representations from transformers BERT and connectionist temporal classification (CTC) transformers. The paper first introduces the fundamental concepts of ASR and discusses the challenges associated with it. It then explains the architecture of BERT and CTC transformers and their potential applications in ASR. The paper reviews several studies that have used these models for speech recognition tasks and discusses the results obtained. Additionally, the paper highlights the limitations of these models and outlines potential areas for further research. All in all, this review provides valuable insights for researchers and practitioners who are interested in ASR with BERT and CTC transformers. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_09456 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Automatic Speech Recognition with BERT and CTC Transformers: A Review Djeffal, Noussaiba Kheddar, Hamza Addou, Djamel Mazari, Ahmed Cherif Himeur, Yassine Computation and Language Audio and Speech Processing This review paper provides a comprehensive analysis of recent advances in automatic speech recognition (ASR) with bidirectional encoder representations from transformers BERT and connectionist temporal classification (CTC) transformers. The paper first introduces the fundamental concepts of ASR and discusses the challenges associated with it. It then explains the architecture of BERT and CTC transformers and their potential applications in ASR. The paper reviews several studies that have used these models for speech recognition tasks and discusses the results obtained. Additionally, the paper highlights the limitations of these models and outlines potential areas for further research. All in all, this review provides valuable insights for researchers and practitioners who are interested in ASR with BERT and CTC transformers. |
| title | Automatic Speech Recognition with BERT and CTC Transformers: A Review |
| topic | Computation and Language Audio and Speech Processing |
| url | https://arxiv.org/abs/2410.09456 |