Saved in:
Bibliographic Details
Main Authors: López-Espejo, Iván, Roselló, Eros, Edraki, Amin, Harte, Naomi, Jensen, Jesper
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2411.03150
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909414087196672
author López-Espejo, Iván
Roselló, Eros
Edraki, Amin
Harte, Naomi
Jensen, Jesper
author_facet López-Espejo, Iván
Roselló, Eros
Edraki, Amin
Harte, Naomi
Jensen, Jesper
contents Advancing the design of robust hearing aid (HA) voice control is crucial to increase the HA use rate among hard of hearing people as well as to improve HA users' experience. In this work, we contribute towards this goal by, first, presenting a novel HA speech dataset consisting of noisy own voice captured by 2 behind-the-ear (BTE) and 1 in-ear-canal (IEC) microphones. Second, we provide baseline HA voice control results from the evaluation of light, state-of-the-art keyword spotting models utilizing different combinations of HA microphone signals. Experimental results show the benefits of exploiting bandwidth-limited bone-conducted speech (BCS) from the IEC microphone to achieve noise-robust HA voice control. Furthermore, results also demonstrate that voice control performance can be boosted by assisting BCS by the broader-bandwidth BTE microphone signals. Aiming at setting a baseline upon which the scientific community can continue to progress, the HA noisy speech dataset has been made publicly available.
format Preprint
id arxiv_https___arxiv_org_abs_2411_03150
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Noise-Robust Hearing Aid Voice Control
López-Espejo, Iván
Roselló, Eros
Edraki, Amin
Harte, Naomi
Jensen, Jesper
Audio and Speech Processing
Advancing the design of robust hearing aid (HA) voice control is crucial to increase the HA use rate among hard of hearing people as well as to improve HA users' experience. In this work, we contribute towards this goal by, first, presenting a novel HA speech dataset consisting of noisy own voice captured by 2 behind-the-ear (BTE) and 1 in-ear-canal (IEC) microphones. Second, we provide baseline HA voice control results from the evaluation of light, state-of-the-art keyword spotting models utilizing different combinations of HA microphone signals. Experimental results show the benefits of exploiting bandwidth-limited bone-conducted speech (BCS) from the IEC microphone to achieve noise-robust HA voice control. Furthermore, results also demonstrate that voice control performance can be boosted by assisting BCS by the broader-bandwidth BTE microphone signals. Aiming at setting a baseline upon which the scientific community can continue to progress, the HA noisy speech dataset has been made publicly available.
title Noise-Robust Hearing Aid Voice Control
topic Audio and Speech Processing
url https://arxiv.org/abs/2411.03150