Spatial Voice Conversion: Voice Conversion Preserving Spatial Information and Non-target Signals
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911932461613056 |
|---|---|
| author | Seki, Kentaro Takamichi, Shinnosuke Takamune, Norihiro Saito, Yuki Imamura, Kanami Saruwatari, Hiroshi |
| author_facet | Seki, Kentaro Takamichi, Shinnosuke Takamune, Norihiro Saito, Yuki Imamura, Kanami Saruwatari, Hiroshi |
| contents | This paper proposes a new task called spatial voice conversion, which aims to convert a target voice while preserving spatial information and non-target signals. Traditional voice conversion methods focus on single-channel waveforms, ignoring the stereo listening experience inherent in human hearing. Our baseline approach addresses this gap by integrating blind source separation (BSS), voice conversion (VC), and spatial mixing to handle multi-channel waveforms. Through experimental evaluations, we organize and identify the key challenges inherent in this task, such as maintaining audio quality and accurately preserving spatial information. Our results highlight the fundamental difficulties in balancing these aspects, providing a benchmark for future research in spatial voice conversion. The proposed method's code is publicly available to encourage further exploration in this domain. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_17722 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Spatial Voice Conversion: Voice Conversion Preserving Spatial Information and Non-target Signals Seki, Kentaro Takamichi, Shinnosuke Takamune, Norihiro Saito, Yuki Imamura, Kanami Saruwatari, Hiroshi Sound Audio and Speech Processing This paper proposes a new task called spatial voice conversion, which aims to convert a target voice while preserving spatial information and non-target signals. Traditional voice conversion methods focus on single-channel waveforms, ignoring the stereo listening experience inherent in human hearing. Our baseline approach addresses this gap by integrating blind source separation (BSS), voice conversion (VC), and spatial mixing to handle multi-channel waveforms. Through experimental evaluations, we organize and identify the key challenges inherent in this task, such as maintaining audio quality and accurately preserving spatial information. Our results highlight the fundamental difficulties in balancing these aspects, providing a benchmark for future research in spatial voice conversion. The proposed method's code is publicly available to encourage further exploration in this domain. |
| title | Spatial Voice Conversion: Voice Conversion Preserving Spatial Information and Non-target Signals |
| topic | Sound Audio and Speech Processing |
| url | https://arxiv.org/abs/2406.17722 |