Audio Editing with Non-Rigid Text Prompts

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Paissan, Francesco, Della Libera, Luca, Wang, Zhepei, Ravanelli, Mirco, Smaragdis, Paris, Subakan, Cem
Natura: Preprint
Pubblicazione: 2023
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912041614180352
author Paissan, Francesco
Della Libera, Luca
Wang, Zhepei
Ravanelli, Mirco
Smaragdis, Paris
Subakan, Cem
author_facet Paissan, Francesco
Della Libera, Luca
Wang, Zhepei
Ravanelli, Mirco
Smaragdis, Paris
Subakan, Cem
contents In this paper, we explore audio-editing with non-rigid text edits. We show that the proposed editing pipeline is able to create audio edits that remain faithful to the input audio. We explore text prompts that perform addition, style transfer, and in-painting. We quantitatively and qualitatively show that the edits are able to obtain results which outperform Audio-LDM, a recently released text-prompted audio generation model. Qualitative inspection of the results points out that the edits given by our approach remain more faithful to the input audio in terms of keeping the original onsets and offsets of the audio events.
format Preprint
id arxiv_https___arxiv_org_abs_2310_12858
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Audio Editing with Non-Rigid Text Prompts
Paissan, Francesco
Della Libera, Luca
Wang, Zhepei
Ravanelli, Mirco
Smaragdis, Paris
Subakan, Cem
Sound
Machine Learning
Audio and Speech Processing
In this paper, we explore audio-editing with non-rigid text edits. We show that the proposed editing pipeline is able to create audio edits that remain faithful to the input audio. We explore text prompts that perform addition, style transfer, and in-painting. We quantitatively and qualitatively show that the edits are able to obtain results which outperform Audio-LDM, a recently released text-prompted audio generation model. Qualitative inspection of the results points out that the edits given by our approach remain more faithful to the input audio in terms of keeping the original onsets and offsets of the audio events.
title Audio Editing with Non-Rigid Text Prompts
topic Sound
Machine Learning
Audio and Speech Processing
url https://arxiv.org/abs/2310.12858