Using Confidence Scores to Improve Eyes-free Detection of Speech Recognition Errors
Fuente:
arXiv
Guardado en:
| Autores principales: | , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866911014495191040 |
|---|---|
| author | Nowrin, Sadia Vertanen, Keith |
| author_facet | Nowrin, Sadia Vertanen, Keith |
| contents | Conversational systems rely heavily on speech recognition to interpret and respond to user commands and queries. Despite progress on speech recognition accuracy, errors may still sometimes occur and can significantly affect the end-user utility of such systems. While visual feedback can help detect errors, it may not always be practical, especially for people who are blind or low-vision. In this study, we investigate ways to improve error detection by manipulating the audio output of the transcribed text based on the recognizer's confidence level in its result. Our findings show that selectively slowing down the audio when the recognizer exhibited uncertainty led to a 12% relative increase in participants' ability to detect errors compared to uniformly slowing the audio. It also reduced the time it took participants to listen to the recognition result and decide if there was an error by 11%. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_20564 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Using Confidence Scores to Improve Eyes-free Detection of Speech Recognition Errors Nowrin, Sadia Vertanen, Keith Human-Computer Interaction Sound Audio and Speech Processing Conversational systems rely heavily on speech recognition to interpret and respond to user commands and queries. Despite progress on speech recognition accuracy, errors may still sometimes occur and can significantly affect the end-user utility of such systems. While visual feedback can help detect errors, it may not always be practical, especially for people who are blind or low-vision. In this study, we investigate ways to improve error detection by manipulating the audio output of the transcribed text based on the recognizer's confidence level in its result. Our findings show that selectively slowing down the audio when the recognizer exhibited uncertainty led to a 12% relative increase in participants' ability to detect errors compared to uniformly slowing the audio. It also reduced the time it took participants to listen to the recognition result and decide if there was an error by 11%. |
| title | Using Confidence Scores to Improve Eyes-free Detection of Speech Recognition Errors |
| topic | Human-Computer Interaction Sound Audio and Speech Processing |
| url | https://arxiv.org/abs/2410.20564 |