Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2508.04402 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911196659056640 |
|---|---|
| author | Mori, Kiyotada Kawano, Seiya Liu, Chaoran Ishi, Carlos Toshinori Contreras, Angel Fernando Garcia Yoshino, Koichiro |
| author_facet | Mori, Kiyotada Kawano, Seiya Liu, Chaoran Ishi, Carlos Toshinori Contreras, Angel Fernando Garcia Yoshino, Koichiro |
| contents | Spoken dialogue systems (SDSs) utilize automatic speech recognition (ASR) at the front end of their pipeline. The role of ASR in SDSs is to recognize information in user speech related to response generation appropriately. Examining selective listening of humans, which refers to the ability to focus on and listen to important parts of a conversation during the speech, will enable us to identify the ASR capabilities required for SDSs and evaluate them. In this study, we experimentally confirmed selective listening when humans generate dialogue responses by comparing human transcriptions for generating dialogue responses and reference transcriptions. Based on our experimental results, we discuss the possibility of a new ASR evaluation method that leverages human selective listening, which can identify the gap between transcription ability between ASR systems and humans. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_04402 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | What Do Humans Hear When Interacting? Experiments on Selective Listening for Evaluating ASR of Spoken Dialogue Systems Mori, Kiyotada Kawano, Seiya Liu, Chaoran Ishi, Carlos Toshinori Contreras, Angel Fernando Garcia Yoshino, Koichiro Computation and Language Spoken dialogue systems (SDSs) utilize automatic speech recognition (ASR) at the front end of their pipeline. The role of ASR in SDSs is to recognize information in user speech related to response generation appropriately. Examining selective listening of humans, which refers to the ability to focus on and listen to important parts of a conversation during the speech, will enable us to identify the ASR capabilities required for SDSs and evaluate them. In this study, we experimentally confirmed selective listening when humans generate dialogue responses by comparing human transcriptions for generating dialogue responses and reference transcriptions. Based on our experimental results, we discuss the possibility of a new ASR evaluation method that leverages human selective listening, which can identify the gap between transcription ability between ASR systems and humans. |
| title | What Do Humans Hear When Interacting? Experiments on Selective Listening for Evaluating ASR of Spoken Dialogue Systems |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2508.04402 |