Reconstruction of Sound Field through Diffusion Models
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914687456641024 |
|---|---|
| author | Miotello, Federico Comanducci, Luca Pezzoli, Mirco Bernardini, Alberto Antonacci, Fabio Sarti, Augusto |
| author_facet | Miotello, Federico Comanducci, Luca Pezzoli, Mirco Bernardini, Alberto Antonacci, Fabio Sarti, Augusto |
| contents | Reconstructing the sound field in a room is an important task for several applications, such as sound control and augmented (AR) or virtual reality (VR). In this paper, we propose a data-driven generative model for reconstructing the magnitude of acoustic fields in rooms with a focus on the modal frequency range. We introduce, for the first time, the use of a conditional Denoising Diffusion Probabilistic Model (DDPM) trained in order to reconstruct the sound field (SF-Diff) over an extended domain. The architecture is devised in order to be conditioned on a set of limited available measurements at different frequencies and generate the sound field in target, unknown, locations. The results show that SF-Diff is able to provide accurate reconstructions, outperforming a state-of-the-art baseline based on kernel interpolation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2312_08821 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Reconstruction of Sound Field through Diffusion Models Miotello, Federico Comanducci, Luca Pezzoli, Mirco Bernardini, Alberto Antonacci, Fabio Sarti, Augusto Audio and Speech Processing Machine Learning Sound Signal Processing Reconstructing the sound field in a room is an important task for several applications, such as sound control and augmented (AR) or virtual reality (VR). In this paper, we propose a data-driven generative model for reconstructing the magnitude of acoustic fields in rooms with a focus on the modal frequency range. We introduce, for the first time, the use of a conditional Denoising Diffusion Probabilistic Model (DDPM) trained in order to reconstruct the sound field (SF-Diff) over an extended domain. The architecture is devised in order to be conditioned on a set of limited available measurements at different frequencies and generate the sound field in target, unknown, locations. The results show that SF-Diff is able to provide accurate reconstructions, outperforming a state-of-the-art baseline based on kernel interpolation. |
| title | Reconstruction of Sound Field through Diffusion Models |
| topic | Audio and Speech Processing Machine Learning Sound Signal Processing |
| url | https://arxiv.org/abs/2312.08821 |