Distance Based Single-Channel Target Speech Extraction

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Shi, Runwu, Yen, Benjamin, Nakadai, Kazuhiro
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916545085571072
author Shi, Runwu
Yen, Benjamin
Nakadai, Kazuhiro
author_facet Shi, Runwu
Yen, Benjamin
Nakadai, Kazuhiro
contents This paper aims to achieve single-channel target speech extraction (TSE) in enclosures by solely utilizing distance information. This is the first work that utilizes only distance cues without using speaker physiological information for single-channel TSE. Inspired by recent single-channel Distance-based separation and extraction methods, we introduce a novel model that efficiently fuses distance information with time-frequency (TF) bins for TSE. Experimental results in both single-room and multi-room scenarios demonstrate the feasibility and effectiveness of our approach. This method can also be employed to estimate the distances of different speakers in mixed speech. Online demos are available at https://runwushi.github.io/distance-demo-page.
format Preprint
id arxiv_https___arxiv_org_abs_2412_20144
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Distance Based Single-Channel Target Speech Extraction
Shi, Runwu
Yen, Benjamin
Nakadai, Kazuhiro
Audio and Speech Processing
Sound
This paper aims to achieve single-channel target speech extraction (TSE) in enclosures by solely utilizing distance information. This is the first work that utilizes only distance cues without using speaker physiological information for single-channel TSE. Inspired by recent single-channel Distance-based separation and extraction methods, we introduce a novel model that efficiently fuses distance information with time-frequency (TF) bins for TSE. Experimental results in both single-room and multi-room scenarios demonstrate the feasibility and effectiveness of our approach. This method can also be employed to estimate the distances of different speakers in mixed speech. Online demos are available at https://runwushi.github.io/distance-demo-page.
title Distance Based Single-Channel Target Speech Extraction
topic Audio and Speech Processing
Sound
url https://arxiv.org/abs/2412.20144