What do neural networks listen to? Exploring the crucial bands in Speech Enhancement using Sinc-convolution

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Ho, Kuan-Hsun, Hung, Jeih-weih, Chen, Berlin
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866911788535119872
author Ho, Kuan-Hsun
Hung, Jeih-weih
Chen, Berlin
author_facet Ho, Kuan-Hsun
Hung, Jeih-weih
Chen, Berlin
contents This study introduces a reformed Sinc-convolution (Sincconv) framework tailored for the encoder component of deep networks for speech enhancement (SE). The reformed Sincconv, based on parametrized sinc functions as band-pass filters, offers notable advantages in terms of training efficiency, filter diversity, and interpretability. The reformed Sinc-conv is evaluated in conjunction with various SE models, showcasing its ability to boost SE performance. Furthermore, the reformed Sincconv provides valuable insights into the specific frequency components that are prioritized in an SE scenario. This opens up a new direction of SE research and improving our knowledge of their operating dynamics.
format Preprint
id arxiv_https___arxiv_org_abs_2403_01785
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle What do neural networks listen to? Exploring the crucial bands in Speech Enhancement using Sinc-convolution
Ho, Kuan-Hsun
Hung, Jeih-weih
Chen, Berlin
Sound
Audio and Speech Processing
This study introduces a reformed Sinc-convolution (Sincconv) framework tailored for the encoder component of deep networks for speech enhancement (SE). The reformed Sincconv, based on parametrized sinc functions as band-pass filters, offers notable advantages in terms of training efficiency, filter diversity, and interpretability. The reformed Sinc-conv is evaluated in conjunction with various SE models, showcasing its ability to boost SE performance. Furthermore, the reformed Sincconv provides valuable insights into the specific frequency components that are prioritized in an SE scenario. This opens up a new direction of SE research and improving our knowledge of their operating dynamics.
title What do neural networks listen to? Exploring the crucial bands in Speech Enhancement using Sinc-convolution
topic Sound
Audio and Speech Processing
url https://arxiv.org/abs/2403.01785