Spectral Masking with Explicit Time-Context Windowing for Neural Network-Based Monaural Speech Enhancement
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916373233401856 |
|---|---|
| author | Fiorio, Luan Vinícius Karanov, Boris Defraene, Bruno David, Johan van Houtum, Wim Widdershoven, Frans Aarts, Ronald M. |
| author_facet | Fiorio, Luan Vinícius Karanov, Boris Defraene, Bruno David, Johan van Houtum, Wim Widdershoven, Frans Aarts, Ronald M. |
| contents | We propose and analyze the use of an explicit time-context window for neural network-based spectral masking speech enhancement to leverage signal context dependencies between neighboring frames. In particular, we concentrate on soft masking and loss computed on the time-frequency representation of the reconstructed speech. We show that the application of a time-context windowing function at both input and output of the neural network model improves the soft mask estimation process by combining multiple estimates taken from different contexts. The proposed approach is only applied as post-optimization in inference mode, not requiring additional layers or special training for the neural network model. Our results show that the method consistently increases both intelligibility and signal quality of the denoised speech, as demonstrated for two classes of convolutional-based speech enhancement models. Importantly, the proposed method requires only a negligible ($\leq1\%$) increase in the number of model parameters, making it suitable for hardware-constrained applications. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_15582 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Spectral Masking with Explicit Time-Context Windowing for Neural Network-Based Monaural Speech Enhancement Fiorio, Luan Vinícius Karanov, Boris Defraene, Bruno David, Johan van Houtum, Wim Widdershoven, Frans Aarts, Ronald M. Audio and Speech Processing Sound We propose and analyze the use of an explicit time-context window for neural network-based spectral masking speech enhancement to leverage signal context dependencies between neighboring frames. In particular, we concentrate on soft masking and loss computed on the time-frequency representation of the reconstructed speech. We show that the application of a time-context windowing function at both input and output of the neural network model improves the soft mask estimation process by combining multiple estimates taken from different contexts. The proposed approach is only applied as post-optimization in inference mode, not requiring additional layers or special training for the neural network model. Our results show that the method consistently increases both intelligibility and signal quality of the denoised speech, as demonstrated for two classes of convolutional-based speech enhancement models. Importantly, the proposed method requires only a negligible ($\leq1\%$) increase in the number of model parameters, making it suitable for hardware-constrained applications. |
| title | Spectral Masking with Explicit Time-Context Windowing for Neural Network-Based Monaural Speech Enhancement |
| topic | Audio and Speech Processing Sound |
| url | https://arxiv.org/abs/2408.15582 |