DeWinder: Single-Channel Wind Noise Reduction using Ultrasound Sensing
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866917772216238080 |
|---|---|
| author | Yuan, Kuang Han, Shuo Kumar, Swarun Raj, Bhiksha |
| author_facet | Yuan, Kuang Han, Shuo Kumar, Swarun Raj, Bhiksha |
| contents | The quality of audio recordings in outdoor environments is often degraded by the presence of wind. Mitigating the impact of wind noise on the perceptual quality of single-channel speech remains a significant challenge due to its non-stationary characteristics. Prior work in noise suppression treats wind noise as a general background noise without explicit modeling of its characteristics. In this paper, we leverage ultrasound as an auxiliary modality to explicitly sense the airflow and characterize the wind noise. We propose a multi-modal deep-learning framework to fuse the ultrasonic Doppler features and speech signals for wind noise reduction. Our results show that DeWinder can significantly improve the noise reduction capabilities of state-of-the-art speech enhancement models. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_06137 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | DeWinder: Single-Channel Wind Noise Reduction using Ultrasound Sensing Yuan, Kuang Han, Shuo Kumar, Swarun Raj, Bhiksha Audio and Speech Processing Sound Signal Processing The quality of audio recordings in outdoor environments is often degraded by the presence of wind. Mitigating the impact of wind noise on the perceptual quality of single-channel speech remains a significant challenge due to its non-stationary characteristics. Prior work in noise suppression treats wind noise as a general background noise without explicit modeling of its characteristics. In this paper, we leverage ultrasound as an auxiliary modality to explicitly sense the airflow and characterize the wind noise. We propose a multi-modal deep-learning framework to fuse the ultrasonic Doppler features and speech signals for wind noise reduction. Our results show that DeWinder can significantly improve the noise reduction capabilities of state-of-the-art speech enhancement models. |
| title | DeWinder: Single-Channel Wind Noise Reduction using Ultrasound Sensing |
| topic | Audio and Speech Processing Sound Signal Processing |
| url | https://arxiv.org/abs/2409.06137 |