Joint Minimum Processing Beamforming and Near-end Listening Enhancement
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911770622296064 |
|---|---|
| author | Fuglsig, Andreas J. Jensen, Jesper Tan, Zheng-Hua Bertelsen, Lars S. Lindof, Jens Christian Østergaard, Jan |
| author_facet | Fuglsig, Andreas J. Jensen, Jesper Tan, Zheng-Hua Bertelsen, Lars S. Lindof, Jens Christian Østergaard, Jan |
| contents | We consider speech enhancement for signals picked up in one noisy environment that must be rendered to a listener in another noisy environment. For both far-end noise reduction and near-end listening enhancement, it has been shown that excessive focus on noise suppression or intelligibility maximization may lead to excessive speech distortions and quality degradations in favorable noise conditions, where intelligibility is already at ceiling level. Recently [1,2] propose to remedy this with a minimum processing framework that either reduces noise or enhances listening a minimum amount given that a certain intelligibility criterion is still satisfied Additionally, it has been shown that joint consideration of both environments improves speech enhancement performance. In this paper, we formulate a joint far- and near-end minimum processing framework, that improves intelligibility while limiting speech distortions in favorable noise conditions. We provide closed-form solutions to specific boundary scenarios and investigate performance for the general case using numerical optimization. We also show concatenating existing minimum processing far- and near-end enhancement methods preserves the effects of the initial methods. Results show that the joint optimization can further improve performance compared to the concatenated approach. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2309_11243 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Joint Minimum Processing Beamforming and Near-end Listening Enhancement Fuglsig, Andreas J. Jensen, Jesper Tan, Zheng-Hua Bertelsen, Lars S. Lindof, Jens Christian Østergaard, Jan Audio and Speech Processing Sound We consider speech enhancement for signals picked up in one noisy environment that must be rendered to a listener in another noisy environment. For both far-end noise reduction and near-end listening enhancement, it has been shown that excessive focus on noise suppression or intelligibility maximization may lead to excessive speech distortions and quality degradations in favorable noise conditions, where intelligibility is already at ceiling level. Recently [1,2] propose to remedy this with a minimum processing framework that either reduces noise or enhances listening a minimum amount given that a certain intelligibility criterion is still satisfied Additionally, it has been shown that joint consideration of both environments improves speech enhancement performance. In this paper, we formulate a joint far- and near-end minimum processing framework, that improves intelligibility while limiting speech distortions in favorable noise conditions. We provide closed-form solutions to specific boundary scenarios and investigate performance for the general case using numerical optimization. We also show concatenating existing minimum processing far- and near-end enhancement methods preserves the effects of the initial methods. Results show that the joint optimization can further improve performance compared to the concatenated approach. |
| title | Joint Minimum Processing Beamforming and Near-end Listening Enhancement |
| topic | Audio and Speech Processing Sound |
| url | https://arxiv.org/abs/2309.11243 |