PlumberNet: Fixing interference leakage after GEV beamforming

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Grondin, François, Rascón, Caleb
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912023351132160
author Grondin, François
Rascón, Caleb
author_facet Grondin, François
Rascón, Caleb
contents Spatial filters can exploit deep-learning-based speech enhancement models to increase their reliability in scenarios with multiple speech sources scenarios. To further improve speech quality, it is common to perform postfiltering on the estimated target speech obtained with spatial filtering. In this work, Generalized Eigenvalue (GEV) beamforming is employed to provide the leakage estimation, along with the estimation of the target speech, to be later used for postfiltering. This improves the enhancement performance over a postfilter that uses the target speech and a reference microphone signal. This work also demonstrates that the spatial covariance matrices (SCMs) can be accurately estimated from the direction of arrival (DoA) of the target and a discriminative selection amongst the pairwise estimated time-frequency masks.
format Preprint
id arxiv_https___arxiv_org_abs_2309_05057
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle PlumberNet: Fixing interference leakage after GEV beamforming
Grondin, François
Rascón, Caleb
Audio and Speech Processing
Sound
Spatial filters can exploit deep-learning-based speech enhancement models to increase their reliability in scenarios with multiple speech sources scenarios. To further improve speech quality, it is common to perform postfiltering on the estimated target speech obtained with spatial filtering. In this work, Generalized Eigenvalue (GEV) beamforming is employed to provide the leakage estimation, along with the estimation of the target speech, to be later used for postfiltering. This improves the enhancement performance over a postfilter that uses the target speech and a reference microphone signal. This work also demonstrates that the spatial covariance matrices (SCMs) can be accurately estimated from the direction of arrival (DoA) of the target and a discriminative selection amongst the pairwise estimated time-frequency masks.
title PlumberNet: Fixing interference leakage after GEV beamforming
topic Audio and Speech Processing
Sound
url https://arxiv.org/abs/2309.05057