Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2508.08684 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909817513181184 |
|---|---|
| author | van Dijk, Bram Kuiper, Tiberon Ahmed, Sirin Aoulad si Levebvre, Armel Johnson, Jake Duin, Jan Mooijaart, Simon Spruit, Marco |
| author_facet | van Dijk, Bram Kuiper, Tiberon Ahmed, Sirin Aoulad si Levebvre, Armel Johnson, Jake Duin, Jan Mooijaart, Simon Spruit, Marco |
| contents | Voice-controlled interfaces can support older adults in clinical contexts -- with chatbots being a prime example -- but reliable Automatic Speech Recognition (ASR) for underrepresented groups remains a bottleneck. This study evaluates state-of-the-art ASR models on language use of older Dutch adults, who interacted with the Welzijn.AI chatbot designed for geriatric contexts. We benchmark generic multilingual ASR models, and models fine-tuned for Dutch spoken by older adults, while also considering processing speed. Our results show that generic multilingual models outperform fine-tuned models, which suggests recent ASR models can generalise well out of the box to real-world datasets. Moreover, our results indicate that truncating generic models is helpful in balancing the accuracy-speed trade-off. Nonetheless, we also find inputs which cause a high word error rate and place them in context. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_08684 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Out of the Box, into the Clinic? Evaluating State-of-the-Art ASR for Clinical Applications for Older Adults van Dijk, Bram Kuiper, Tiberon Ahmed, Sirin Aoulad si Levebvre, Armel Johnson, Jake Duin, Jan Mooijaart, Simon Spruit, Marco Computation and Language Computers and Society Voice-controlled interfaces can support older adults in clinical contexts -- with chatbots being a prime example -- but reliable Automatic Speech Recognition (ASR) for underrepresented groups remains a bottleneck. This study evaluates state-of-the-art ASR models on language use of older Dutch adults, who interacted with the Welzijn.AI chatbot designed for geriatric contexts. We benchmark generic multilingual ASR models, and models fine-tuned for Dutch spoken by older adults, while also considering processing speed. Our results show that generic multilingual models outperform fine-tuned models, which suggests recent ASR models can generalise well out of the box to real-world datasets. Moreover, our results indicate that truncating generic models is helpful in balancing the accuracy-speed trade-off. Nonetheless, we also find inputs which cause a high word error rate and place them in context. |
| title | Out of the Box, into the Clinic? Evaluating State-of-the-Art ASR for Clinical Applications for Older Adults |
| topic | Computation and Language Computers and Society |
| url | https://arxiv.org/abs/2508.08684 |