Robust Cross-Etiology and Speaker-Independent Dysarthric Speech Recognition

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Singh, Satwinder, Wang, Qianli, Zhong, Zihan, Mendes, Clarion, Hasegawa-Johnson, Mark, Abdulla, Waleed, Shahamiri, Seyed Reza
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916582034243584
author Singh, Satwinder
Wang, Qianli
Zhong, Zihan
Mendes, Clarion
Hasegawa-Johnson, Mark
Abdulla, Waleed
Shahamiri, Seyed Reza
author_facet Singh, Satwinder
Wang, Qianli
Zhong, Zihan
Mendes, Clarion
Hasegawa-Johnson, Mark
Abdulla, Waleed
Shahamiri, Seyed Reza
contents In this paper, we present a speaker-independent dysarthric speech recognition system, with a focus on evaluating the recently released Speech Accessibility Project (SAP-1005) dataset, which includes speech data from individuals with Parkinson's disease (PD). Despite the growing body of research in dysarthric speech recognition, many existing systems are speaker-dependent and adaptive, limiting their generalizability across different speakers and etiologies. Our primary objective is to develop a robust speaker-independent model capable of accurately recognizing dysarthric speech, irrespective of the speaker. Additionally, as a secondary objective, we aim to test the cross-etiology performance of our model by evaluating it on the TORGO dataset, which contains speech samples from individuals with cerebral palsy (CP) and amyotrophic lateral sclerosis (ALS). By leveraging the Whisper model, our speaker-independent system achieved a CER of 6.99% and a WER of 10.71% on the SAP-1005 dataset. Further, in cross-etiology settings, we achieved a CER of 25.08% and a WER of 39.56% on the TORGO dataset. These results highlight the potential of our approach to generalize across unseen speakers and different etiologies of dysarthria.
format Preprint
id arxiv_https___arxiv_org_abs_2501_14994
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Robust Cross-Etiology and Speaker-Independent Dysarthric Speech Recognition
Singh, Satwinder
Wang, Qianli
Zhong, Zihan
Mendes, Clarion
Hasegawa-Johnson, Mark
Abdulla, Waleed
Shahamiri, Seyed Reza
Sound
Artificial Intelligence
Machine Learning
Audio and Speech Processing
In this paper, we present a speaker-independent dysarthric speech recognition system, with a focus on evaluating the recently released Speech Accessibility Project (SAP-1005) dataset, which includes speech data from individuals with Parkinson's disease (PD). Despite the growing body of research in dysarthric speech recognition, many existing systems are speaker-dependent and adaptive, limiting their generalizability across different speakers and etiologies. Our primary objective is to develop a robust speaker-independent model capable of accurately recognizing dysarthric speech, irrespective of the speaker. Additionally, as a secondary objective, we aim to test the cross-etiology performance of our model by evaluating it on the TORGO dataset, which contains speech samples from individuals with cerebral palsy (CP) and amyotrophic lateral sclerosis (ALS). By leveraging the Whisper model, our speaker-independent system achieved a CER of 6.99% and a WER of 10.71% on the SAP-1005 dataset. Further, in cross-etiology settings, we achieved a CER of 25.08% and a WER of 39.56% on the TORGO dataset. These results highlight the potential of our approach to generalize across unseen speakers and different etiologies of dysarthria.
title Robust Cross-Etiology and Speaker-Independent Dysarthric Speech Recognition
topic Sound
Artificial Intelligence
Machine Learning
Audio and Speech Processing
url https://arxiv.org/abs/2501.14994