SeamlessEdit: Background Noise Aware Zero-Shot Speech Editing with in-Context Enhancement
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911691214684160 |
|---|---|
| author | Chen, Kuan-Yu Li, Jeng-Lin Lu, De-Yan Ding, Jian-Jiun |
| author_facet | Chen, Kuan-Yu Li, Jeng-Lin Lu, De-Yan Ding, Jian-Jiun |
| contents | With the fast development of zero-shot text-to-speech technologies, it is possible to generate high-quality speech signals that are indistinguishable from the real ones. Speech editing, including speech insertion and replacement, appeals to researchers due to its potential applications. However, existing studies only considered clean speech scenarios. In real-world applications, the existence of environmental noise could significantly degrade the quality of generation. In this study, we propose a noise-resilient speech editing framework, SeamlessEdit, for noisy speech editing. SeamlessEdit adopts a frequency-band-aware noise suppression module and an in-content refinement strategy. It can well address the scenario where the frequency bands of voice and background noise are not separated. The proposed SeamlessEdit framework outperforms state-of-the-art approaches in multiple quantitative and qualitative evaluations. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_14066 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | SeamlessEdit: Background Noise Aware Zero-Shot Speech Editing with in-Context Enhancement Chen, Kuan-Yu Li, Jeng-Lin Lu, De-Yan Ding, Jian-Jiun Audio and Speech Processing Sound 68T45 I.2.7; H.5.5 With the fast development of zero-shot text-to-speech technologies, it is possible to generate high-quality speech signals that are indistinguishable from the real ones. Speech editing, including speech insertion and replacement, appeals to researchers due to its potential applications. However, existing studies only considered clean speech scenarios. In real-world applications, the existence of environmental noise could significantly degrade the quality of generation. In this study, we propose a noise-resilient speech editing framework, SeamlessEdit, for noisy speech editing. SeamlessEdit adopts a frequency-band-aware noise suppression module and an in-content refinement strategy. It can well address the scenario where the frequency bands of voice and background noise are not separated. The proposed SeamlessEdit framework outperforms state-of-the-art approaches in multiple quantitative and qualitative evaluations. |
| title | SeamlessEdit: Background Noise Aware Zero-Shot Speech Editing with in-Context Enhancement |
| topic | Audio and Speech Processing Sound 68T45 I.2.7; H.5.5 |
| url | https://arxiv.org/abs/2505.14066 |