Automatic Speech Recognition (ASR) for the Diagnosis of pronunciation of Speech Sound Disorders in Korean children
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866916157651419136 |
|---|---|
| author | Ahn, Taekyung Hong, Yeonjung Im, Younggon Kim, Do Hyung Kang, Dayoung Jeong, Joo Won Kim, Jae Won Kim, Min Jung Cho, Ah-ra Jang, Dae-Hyun Nam, Hosung |
| author_facet | Ahn, Taekyung Hong, Yeonjung Im, Younggon Kim, Do Hyung Kang, Dayoung Jeong, Joo Won Kim, Jae Won Kim, Min Jung Cho, Ah-ra Jang, Dae-Hyun Nam, Hosung |
| contents | This study presents a model of automatic speech recognition (ASR) designed to diagnose pronunciation issues in children with speech sound disorders (SSDs) to replace manual transcriptions in clinical procedures. Since ASR models trained for general purposes primarily predict input speech into real words, employing a well-known high-performance ASR model for evaluating pronunciation in children with SSDs is impractical. We fine-tuned the wav2vec 2.0 XLS-R model to recognize speech as pronounced rather than as existing words. The model was fine-tuned with a speech dataset from 137 children with inadequate speech production pronouncing 73 Korean words selected for actual clinical diagnosis. The model's predictions of the pronunciations of the words matched the human annotations with about 90% accuracy. While the model still requires improvement in recognizing unclear pronunciation, this study demonstrates that ASR models can streamline complex pronunciation error diagnostic procedures in clinical fields. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_08187 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Automatic Speech Recognition (ASR) for the Diagnosis of pronunciation of Speech Sound Disorders in Korean children Ahn, Taekyung Hong, Yeonjung Im, Younggon Kim, Do Hyung Kang, Dayoung Jeong, Joo Won Kim, Jae Won Kim, Min Jung Cho, Ah-ra Jang, Dae-Hyun Nam, Hosung Computation and Language Sound Audio and Speech Processing I.2.7 This study presents a model of automatic speech recognition (ASR) designed to diagnose pronunciation issues in children with speech sound disorders (SSDs) to replace manual transcriptions in clinical procedures. Since ASR models trained for general purposes primarily predict input speech into real words, employing a well-known high-performance ASR model for evaluating pronunciation in children with SSDs is impractical. We fine-tuned the wav2vec 2.0 XLS-R model to recognize speech as pronounced rather than as existing words. The model was fine-tuned with a speech dataset from 137 children with inadequate speech production pronouncing 73 Korean words selected for actual clinical diagnosis. The model's predictions of the pronunciations of the words matched the human annotations with about 90% accuracy. While the model still requires improvement in recognizing unclear pronunciation, this study demonstrates that ASR models can streamline complex pronunciation error diagnostic procedures in clinical fields. |
| title | Automatic Speech Recognition (ASR) for the Diagnosis of pronunciation of Speech Sound Disorders in Korean children |
| topic | Computation and Language Sound Audio and Speech Processing I.2.7 |
| url | https://arxiv.org/abs/2403.08187 |