Improving Whispered Speech Recognition Performance using Pseudo-whispered based Data Augmentation
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , |
|---|---|
| Format: | Preprint |
| Publié: |
2023
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866911772456255488 |
|---|---|
| author | Lin, Zhaofeng Patel, Tanvina Scharenborg, Odette |
| author_facet | Lin, Zhaofeng Patel, Tanvina Scharenborg, Odette |
| contents | Whispering is a distinct form of speech known for its soft, breathy, and hushed characteristics, often used for private communication. The acoustic characteristics of whispered speech differ substantially from normally phonated speech and the scarcity of adequate training data leads to low automatic speech recognition (ASR) performance. To address the data scarcity issue, we use a signal processing-based technique that transforms the spectral characteristics of normal speech to those of pseudo-whispered speech. We augment an End-to-End ASR with pseudo-whispered speech and achieve an 18.2% relative reduction in word error rate for whispered speech compared to the baseline. Results for the individual speaker groups in the wTIMIT database show the best results for US English. Further investigation showed that the lack of glottal information in whispered speech has the largest impact on whispered speech ASR performance. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2311_05179 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Improving Whispered Speech Recognition Performance using Pseudo-whispered based Data Augmentation Lin, Zhaofeng Patel, Tanvina Scharenborg, Odette Audio and Speech Processing Sound Whispering is a distinct form of speech known for its soft, breathy, and hushed characteristics, often used for private communication. The acoustic characteristics of whispered speech differ substantially from normally phonated speech and the scarcity of adequate training data leads to low automatic speech recognition (ASR) performance. To address the data scarcity issue, we use a signal processing-based technique that transforms the spectral characteristics of normal speech to those of pseudo-whispered speech. We augment an End-to-End ASR with pseudo-whispered speech and achieve an 18.2% relative reduction in word error rate for whispered speech compared to the baseline. Results for the individual speaker groups in the wTIMIT database show the best results for US English. Further investigation showed that the lack of glottal information in whispered speech has the largest impact on whispered speech ASR performance. |
| title | Improving Whispered Speech Recognition Performance using Pseudo-whispered based Data Augmentation |
| topic | Audio and Speech Processing Sound |
| url | https://arxiv.org/abs/2311.05179 |