Regularized Federated Learning for Privacy-Preserving Dysarthric and Elderly Speech Recognition

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhong, Tao, Geng, Mengzhe, Hu, Shujie, Li, Guinan, Liu, Xunying
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911002910523392
author Zhong, Tao
Geng, Mengzhe
Hu, Shujie
Li, Guinan
Liu, Xunying
author_facet Zhong, Tao
Geng, Mengzhe
Hu, Shujie
Li, Guinan
Liu, Xunying
contents Accurate recognition of dysarthric and elderly speech remains challenging to date. While privacy concerns have driven a shift from centralized approaches to federated learning (FL) to ensure data confidentiality, this further exacerbates the challenges of data scarcity, imbalanced data distribution and speaker heterogeneity. To this end, this paper conducts a systematic investigation of regularized FL techniques for privacy-preserving dysarthric and elderly speech recognition, addressing different levels of the FL process by 1) parameter-based, 2) embedding-based and 3) novel loss-based regularization. Experiments on the benchmark UASpeech dysarthric and DementiaBank Pitt elderly speech corpora suggest that regularized FL systems consistently outperform the baseline FedAvg system by statistically significant WER reductions of up to 0.55\% absolute (2.13\% relative). Further increasing communication frequency to one exchange per batch approaches centralized training performance.
format Preprint
id arxiv_https___arxiv_org_abs_2506_11069
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Regularized Federated Learning for Privacy-Preserving Dysarthric and Elderly Speech Recognition
Zhong, Tao
Geng, Mengzhe
Hu, Shujie
Li, Guinan
Liu, Xunying
Audio and Speech Processing
Artificial Intelligence
Computation and Language
Sound
Accurate recognition of dysarthric and elderly speech remains challenging to date. While privacy concerns have driven a shift from centralized approaches to federated learning (FL) to ensure data confidentiality, this further exacerbates the challenges of data scarcity, imbalanced data distribution and speaker heterogeneity. To this end, this paper conducts a systematic investigation of regularized FL techniques for privacy-preserving dysarthric and elderly speech recognition, addressing different levels of the FL process by 1) parameter-based, 2) embedding-based and 3) novel loss-based regularization. Experiments on the benchmark UASpeech dysarthric and DementiaBank Pitt elderly speech corpora suggest that regularized FL systems consistently outperform the baseline FedAvg system by statistically significant WER reductions of up to 0.55\% absolute (2.13\% relative). Further increasing communication frequency to one exchange per batch approaches centralized training performance.
title Regularized Federated Learning for Privacy-Preserving Dysarthric and Elderly Speech Recognition
topic Audio and Speech Processing
Artificial Intelligence
Computation and Language
Sound
url https://arxiv.org/abs/2506.11069