Adaptive Noise Resilient Keyword Spotting Using One-Shot Learning

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Martinez-Rau, Luciano Sebastian, Vu, Quynh Nguyen Phuong, Zhang, Yuxuan, Oelmann, Bengt, Bader, Sebastian
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866915448549801984
author Martinez-Rau, Luciano Sebastian
Vu, Quynh Nguyen Phuong
Zhang, Yuxuan
Oelmann, Bengt
Bader, Sebastian
author_facet Martinez-Rau, Luciano Sebastian
Vu, Quynh Nguyen Phuong
Zhang, Yuxuan
Oelmann, Bengt
Bader, Sebastian
contents Keyword spotting (KWS) is a key component of smart devices, enabling efficient and intuitive audio interaction. However, standard KWS systems deployed on embedded devices often suffer performance degradation under real-world operating conditions. Resilient KWS systems address this issue by enabling dynamic adaptation, with applications such as adding or replacing keywords, adjusting to specific users, and improving noise robustness. However, deploying resilient, standalone KWS systems with low latency on resource-constrained devices remains challenging due to limited memory and computational resources. This study proposes a low computational approach for continuous noise adaptation of pretrained neural networks used for KWS classification, requiring only 1-shot learning and one epoch. The proposed method was assessed using two pretrained models and three real-world noise sources at signal-to-noise ratios (SNRs) ranging from 24 to -3 dB. The adapted models consistently outperformed the pretrained models across all scenarios, especially at SNR $\leq$ 18 dB, achieving accuracy improvements of 4.9% to 46.0%. These results highlight the efficacy of the proposed methodology while being lightweight enough for deployment on resource-constrained devices.
format Preprint
id arxiv_https___arxiv_org_abs_2505_09304
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Adaptive Noise Resilient Keyword Spotting Using One-Shot Learning
Martinez-Rau, Luciano Sebastian
Vu, Quynh Nguyen Phuong
Zhang, Yuxuan
Oelmann, Bengt
Bader, Sebastian
Sound
Machine Learning
Audio and Speech Processing
Keyword spotting (KWS) is a key component of smart devices, enabling efficient and intuitive audio interaction. However, standard KWS systems deployed on embedded devices often suffer performance degradation under real-world operating conditions. Resilient KWS systems address this issue by enabling dynamic adaptation, with applications such as adding or replacing keywords, adjusting to specific users, and improving noise robustness. However, deploying resilient, standalone KWS systems with low latency on resource-constrained devices remains challenging due to limited memory and computational resources. This study proposes a low computational approach for continuous noise adaptation of pretrained neural networks used for KWS classification, requiring only 1-shot learning and one epoch. The proposed method was assessed using two pretrained models and three real-world noise sources at signal-to-noise ratios (SNRs) ranging from 24 to -3 dB. The adapted models consistently outperformed the pretrained models across all scenarios, especially at SNR $\leq$ 18 dB, achieving accuracy improvements of 4.9% to 46.0%. These results highlight the efficacy of the proposed methodology while being lightweight enough for deployment on resource-constrained devices.
title Adaptive Noise Resilient Keyword Spotting Using One-Shot Learning
topic Sound
Machine Learning
Audio and Speech Processing
url https://arxiv.org/abs/2505.09304