GAN-Based Multi-Microphone Spatial Target Speaker Extraction
Fuente:
arXiv
Guardado en:
| Autores principales: | , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866916960709640192 |
|---|---|
| author | Shetu, Shrishti Saha Habets, Emanuël A. P. Brendel, Andreas |
| author_facet | Shetu, Shrishti Saha Habets, Emanuël A. P. Brendel, Andreas |
| contents | Spatial target speaker extraction isolates a desired speaker's voice in multi-speaker environments using spatial information, such as the direction of arrival (DoA). Although recent deep neural network (DNN)-based discriminative methods have shown significant performance improvements, the potential of generative approaches, such as generative adversarial networks (GANs), remains largely unexplored for this problem. In this work, we demonstrate that a GAN can effectively leverage both noisy mixtures and spatial information to extract and generate the target speaker's speech. By conditioning the GAN on intermediate features of a discriminative spatial filtering model in addition to DoA, we enable steerable target extraction with high spatial resolution of 5 degrees, outperforming state-of-the-art discriminative methods in perceptual quality-based objective metrics. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_17741 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | GAN-Based Multi-Microphone Spatial Target Speaker Extraction Shetu, Shrishti Saha Habets, Emanuël A. P. Brendel, Andreas Audio and Speech Processing Spatial target speaker extraction isolates a desired speaker's voice in multi-speaker environments using spatial information, such as the direction of arrival (DoA). Although recent deep neural network (DNN)-based discriminative methods have shown significant performance improvements, the potential of generative approaches, such as generative adversarial networks (GANs), remains largely unexplored for this problem. In this work, we demonstrate that a GAN can effectively leverage both noisy mixtures and spatial information to extract and generate the target speaker's speech. By conditioning the GAN on intermediate features of a discriminative spatial filtering model in addition to DoA, we enable steerable target extraction with high spatial resolution of 5 degrees, outperforming state-of-the-art discriminative methods in perceptual quality-based objective metrics. |
| title | GAN-Based Multi-Microphone Spatial Target Speaker Extraction |
| topic | Audio and Speech Processing |
| url | https://arxiv.org/abs/2509.17741 |