Location-Oriented Sound Event Localization and Detection with Spatial Mapping and Regression Localization

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhang, Xueping, Chen, Yaxiong, Yao, Ruilin, Zi, Yunfei, Xiong, Shengwu
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915762832146432
author Zhang, Xueping
Chen, Yaxiong
Yao, Ruilin
Zi, Yunfei
Xiong, Shengwu
author_facet Zhang, Xueping
Chen, Yaxiong
Yao, Ruilin
Zi, Yunfei
Xiong, Shengwu
contents Sound Event Localization and Detection (SELD) combines the Sound Event Detection (SED) with the corresponding Direction Of Arrival (DOA). Recently, adopted event oriented multi-track methods affect the generality in polyphonic environments due to the limitation of the number of tracks. To enhance the generality in polyphonic environments, we propose Spatial Mapping and Regression Localization for SELD (SMRL-SELD). SMRL-SELD segments the 3D spatial space, mapping it to a 2D plane, and a new regression localization loss is proposed to help the results converge toward the location of the corresponding event. SMRL-SELD is location-oriented, allowing the model to learn event features based on orientation. Thus, the method enables the model to process polyphonic sounds regardless of the number of overlapping events. We conducted experiments on STARSS23 and STARSS22 datasets and our proposed SMRL-SELD outperforms the existing SELD methods in overall evaluation and polyphony environments.
format Preprint
id arxiv_https___arxiv_org_abs_2504_08365
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Location-Oriented Sound Event Localization and Detection with Spatial Mapping and Regression Localization
Zhang, Xueping
Chen, Yaxiong
Yao, Ruilin
Zi, Yunfei
Xiong, Shengwu
Sound
Audio and Speech Processing
Sound Event Localization and Detection (SELD) combines the Sound Event Detection (SED) with the corresponding Direction Of Arrival (DOA). Recently, adopted event oriented multi-track methods affect the generality in polyphonic environments due to the limitation of the number of tracks. To enhance the generality in polyphonic environments, we propose Spatial Mapping and Regression Localization for SELD (SMRL-SELD). SMRL-SELD segments the 3D spatial space, mapping it to a 2D plane, and a new regression localization loss is proposed to help the results converge toward the location of the corresponding event. SMRL-SELD is location-oriented, allowing the model to learn event features based on orientation. Thus, the method enables the model to process polyphonic sounds regardless of the number of overlapping events. We conducted experiments on STARSS23 and STARSS22 datasets and our proposed SMRL-SELD outperforms the existing SELD methods in overall evaluation and polyphony environments.
title Location-Oriented Sound Event Localization and Detection with Spatial Mapping and Regression Localization
topic Sound
Audio and Speech Processing
url https://arxiv.org/abs/2504.08365