Saved in:
Bibliographic Details
Main Authors: Trinh, Quoc-Huy, Nguyen, Minh-Van, Mau, Trong-Hieu Nguyen, Tran, Khoa, Do, Thanh
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2411.01661
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916478440177664
author Trinh, Quoc-Huy
Nguyen, Minh-Van
Mau, Trong-Hieu Nguyen
Tran, Khoa
Do, Thanh
author_facet Trinh, Quoc-Huy
Nguyen, Minh-Van
Mau, Trong-Hieu Nguyen
Tran, Khoa
Do, Thanh
contents Singing is one of the most cherished forms of human entertainment. However, creating a beautiful song requires an accompaniment that complements the vocals and aligns well with the song instruments and genre. With advancements in deep learning, previous research has focused on generating suitable accompaniments but often lacks precise alignment with the desired instrumentation and genre. To address this, we propose a straightforward method that enables control over the accompaniment through text prompts, allowing the generation of music that complements the vocals and aligns with the song instrumental and genre requirements. Through extensive experiments, we successfully generate 10-second accompaniments using vocal input and text control.
format Preprint
id arxiv_https___arxiv_org_abs_2411_01661
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Sing-On-Your-Beat: Simple Text-Controllable Accompaniment Generations
Trinh, Quoc-Huy
Nguyen, Minh-Van
Mau, Trong-Hieu Nguyen
Tran, Khoa
Do, Thanh
Sound
Artificial Intelligence
Audio and Speech Processing
Singing is one of the most cherished forms of human entertainment. However, creating a beautiful song requires an accompaniment that complements the vocals and aligns well with the song instruments and genre. With advancements in deep learning, previous research has focused on generating suitable accompaniments but often lacks precise alignment with the desired instrumentation and genre. To address this, we propose a straightforward method that enables control over the accompaniment through text prompts, allowing the generation of music that complements the vocals and aligns with the song instrumental and genre requirements. Through extensive experiments, we successfully generate 10-second accompaniments using vocal input and text control.
title Sing-On-Your-Beat: Simple Text-Controllable Accompaniment Generations
topic Sound
Artificial Intelligence
Audio and Speech Processing
url https://arxiv.org/abs/2411.01661