NDF+: Joint Neural Directional Filtering and Diffuse Sound Extraction

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Huang, Weilong, Huynh, Le Nhat Tam, Thiergart, Oliver, Habets, Emanuël A. P.
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911657122332672
author Huang, Weilong
Huynh, Le Nhat Tam
Thiergart, Oliver
Habets, Emanuël A. P.
author_facet Huang, Weilong
Huynh, Le Nhat Tam
Thiergart, Oliver
Habets, Emanuël A. P.
contents Recently, neural directional filtering (NDF) has been introduced as a flexible approach for reconstructing a virtual directional microphone (VDM) with a desired directivity pattern for spatial sound capture. Building on this idea, we propose NDF+, which enables joint neural directional filtering and diffuse sound extraction. NDF+ reformulates VDM estimation into two coupled subtasks: dereverberated VDM reconstruction and diffuse sound extraction. This reformulation enables NDF+ to manipulate diffuse components in the final reconstructed VDM output. We evaluated NDF+ under reverberant conditions and compared it with representative conventional baselines. Results show that NDF+ consistently outperforms the baselines on both subtasks, while maintaining VDM reconstruction quality comparable to that of the original single-task NDF model. These findings indicate that NDF+ introduces an additional degree of freedom for diffuse sound control in the VDM reconstruction. In a stereo recording application, NDF+ provides controllable inter-channel level differences between left and right channels by adjusting the estimated diffuse component.
format Preprint
id arxiv_https___arxiv_org_abs_2605_06108
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle NDF+: Joint Neural Directional Filtering and Diffuse Sound Extraction
Huang, Weilong
Huynh, Le Nhat Tam
Thiergart, Oliver
Habets, Emanuël A. P.
Audio and Speech Processing
Recently, neural directional filtering (NDF) has been introduced as a flexible approach for reconstructing a virtual directional microphone (VDM) with a desired directivity pattern for spatial sound capture. Building on this idea, we propose NDF+, which enables joint neural directional filtering and diffuse sound extraction. NDF+ reformulates VDM estimation into two coupled subtasks: dereverberated VDM reconstruction and diffuse sound extraction. This reformulation enables NDF+ to manipulate diffuse components in the final reconstructed VDM output. We evaluated NDF+ under reverberant conditions and compared it with representative conventional baselines. Results show that NDF+ consistently outperforms the baselines on both subtasks, while maintaining VDM reconstruction quality comparable to that of the original single-task NDF model. These findings indicate that NDF+ introduces an additional degree of freedom for diffuse sound control in the VDM reconstruction. In a stereo recording application, NDF+ provides controllable inter-channel level differences between left and right channels by adjusting the estimated diffuse component.
title NDF+: Joint Neural Directional Filtering and Diffuse Sound Extraction
topic Audio and Speech Processing
url https://arxiv.org/abs/2605.06108