Reverse Attention for Lightweight Speech Enhancement on Edge Devices

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Ojha, Shuubham, Gervits, Felix, Espy-Wilson, Carol
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866916959015141376
author Ojha, Shuubham
Gervits, Felix
Espy-Wilson, Carol
author_facet Ojha, Shuubham
Gervits, Felix
Espy-Wilson, Carol
contents This paper introduces a lightweight deep learning model for real-time speech enhancement, designed to operate efficiently on resource-constrained devices. The proposed model leverages a compact architecture that facilitates rapid inference without compromising performance. Key contributions include infusing soft attention-based attention gates in the U-Net architecture which is known to perform well for segmentation tasks and is optimized for GPUs. Experimental evaluations demonstrate that the model achieves competitive speech quality and intelligibility metrics, such as PESQ and Word Error Rates (WER), improving the performance of similarly sized baseline models. We are able to achieve a 6.24% WER improvement and a 0.64 PESQ score improvement over un-enhanced waveforms.
format Preprint
id arxiv_https___arxiv_org_abs_2509_16705
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Reverse Attention for Lightweight Speech Enhancement on Edge Devices
Ojha, Shuubham
Gervits, Felix
Espy-Wilson, Carol
Audio and Speech Processing
Sound
This paper introduces a lightweight deep learning model for real-time speech enhancement, designed to operate efficiently on resource-constrained devices. The proposed model leverages a compact architecture that facilitates rapid inference without compromising performance. Key contributions include infusing soft attention-based attention gates in the U-Net architecture which is known to perform well for segmentation tasks and is optimized for GPUs. Experimental evaluations demonstrate that the model achieves competitive speech quality and intelligibility metrics, such as PESQ and Word Error Rates (WER), improving the performance of similarly sized baseline models. We are able to achieve a 6.24% WER improvement and a 0.64 PESQ score improvement over un-enhanced waveforms.
title Reverse Attention for Lightweight Speech Enhancement on Edge Devices
topic Audio and Speech Processing
Sound
url https://arxiv.org/abs/2509.16705