Audio Simulation for Sound Source Localization in Virtual Evironment

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Di Yuan, Yi, Wong, Swee Liang, Pan, Jonathan
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910395667578880
author Di Yuan, Yi
Wong, Swee Liang
Pan, Jonathan
author_facet Di Yuan, Yi
Wong, Swee Liang
Pan, Jonathan
contents Non-line-of-sight localization in signal-deprived environments is a challenging yet pertinent problem. Acoustic methods in such predominantly indoor scenarios encounter difficulty due to the reverberant nature. In this study, we aim to locate sound sources to specific locations within a virtual environment by leveraging physically grounded sound propagation simulations and machine learning methods. This process attempts to overcome the issue of data insufficiency to localize sound sources to their location of occurrence especially in post-event localization. We achieve 0.786+/- 0.0136 F1-score using an audio transformer spectrogram approach.
format Preprint
id arxiv_https___arxiv_org_abs_2404_01611
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Audio Simulation for Sound Source Localization in Virtual Evironment
Di Yuan, Yi
Wong, Swee Liang
Pan, Jonathan
Machine Learning
Sound
Audio and Speech Processing
Non-line-of-sight localization in signal-deprived environments is a challenging yet pertinent problem. Acoustic methods in such predominantly indoor scenarios encounter difficulty due to the reverberant nature. In this study, we aim to locate sound sources to specific locations within a virtual environment by leveraging physically grounded sound propagation simulations and machine learning methods. This process attempts to overcome the issue of data insufficiency to localize sound sources to their location of occurrence especially in post-event localization. We achieve 0.786+/- 0.0136 F1-score using an audio transformer spectrogram approach.
title Audio Simulation for Sound Source Localization in Virtual Evironment
topic Machine Learning
Sound
Audio and Speech Processing
url https://arxiv.org/abs/2404.01611