Self-Guided Target Sound Extraction and Classification Through Universal Sound Separation Model and Multiple Clues

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Kwon, Younghoo, Lee, Dongheon, Kim, Dohwan, Choi, Jung-Woo
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866911159004692480
author Kwon, Younghoo
Lee, Dongheon
Kim, Dohwan
Choi, Jung-Woo
author_facet Kwon, Younghoo
Lee, Dongheon
Kim, Dohwan
Choi, Jung-Woo
contents This paper introduces a multi-stage self-directed framework designed to address the spatial semantic segmentation of sound scene (S5) task in the DCASE 2025 Task 4 challenge. This framework integrates models focused on three distinct tasks: Universal Sound Separation (USS), Single-label Classification (SC), and Target Sound Extraction (TSE). Initially, USS breaks down a complex audio mixture into separate source waveforms. Each of these separated waveforms is then processed by a SC block, generating two critical pieces of information: the waveform itself and its corresponding class label. These serve as inputs for the TSE stage, which isolates the source that matches this information. Since these inputs are produced within the system, the extraction target is identified autonomously, removing the necessity for external guidance. The extracted waveform can be looped back into the classification task, creating a cycle of iterative refinement that progressively enhances both separability and labeling accuracy. We thus call our framework a multi-stage self-guided system due to these self-contained characteristics. On the official evaluation dataset, the proposed system achieves an 11.00 dB increase in class-aware signal-to-distortion ratio improvement (CA-SDRi) and a 55.8\% accuracy in label prediction, outperforming the ResUNetK baseline by 4.4 dB and 4.3\%, respectively, and achieving first place among all submissions.
format Preprint
id arxiv_https___arxiv_org_abs_2509_13741
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Self-Guided Target Sound Extraction and Classification Through Universal Sound Separation Model and Multiple Clues
Kwon, Younghoo
Lee, Dongheon
Kim, Dohwan
Choi, Jung-Woo
Audio and Speech Processing
This paper introduces a multi-stage self-directed framework designed to address the spatial semantic segmentation of sound scene (S5) task in the DCASE 2025 Task 4 challenge. This framework integrates models focused on three distinct tasks: Universal Sound Separation (USS), Single-label Classification (SC), and Target Sound Extraction (TSE). Initially, USS breaks down a complex audio mixture into separate source waveforms. Each of these separated waveforms is then processed by a SC block, generating two critical pieces of information: the waveform itself and its corresponding class label. These serve as inputs for the TSE stage, which isolates the source that matches this information. Since these inputs are produced within the system, the extraction target is identified autonomously, removing the necessity for external guidance. The extracted waveform can be looped back into the classification task, creating a cycle of iterative refinement that progressively enhances both separability and labeling accuracy. We thus call our framework a multi-stage self-guided system due to these self-contained characteristics. On the official evaluation dataset, the proposed system achieves an 11.00 dB increase in class-aware signal-to-distortion ratio improvement (CA-SDRi) and a 55.8\% accuracy in label prediction, outperforming the ResUNetK baseline by 4.4 dB and 4.3\%, respectively, and achieving first place among all submissions.
title Self-Guided Target Sound Extraction and Classification Through Universal Sound Separation Model and Multiple Clues
topic Audio and Speech Processing
url https://arxiv.org/abs/2509.13741