Seed-Music: A Unified Framework for High Quality and Controlled Music Generation
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866917779774373888 |
|---|---|
| author | Bai, Ye Chen, Haonan Chen, Jitong Chen, Zhuo Deng, Yi Dong, Xiaohong Hantrakul, Lamtharn Hao, Weituo Huang, Qingqing Huang, Zhongyi Jia, Dongya La, Feihu Le, Duc Li, Bochen Li, Chumin Li, Hui Li, Xingxing Liu, Shouda Lu, Wei-Tsung Lu, Yiqing Shaw, Andrew Spijkervet, Janne Sun, Yakun Wang, Bo Wang, Ju-Chiang Wang, Yuping Wang, Yuxuan Xu, Ling Yang, Yifeng Yao, Chao Zhang, Shuo Zhang, Yang Zhang, Yilin Zhao, Hang Zhao, Ziyi Zhong, Dejian Zhou, Shicen Zou, Pei |
| author_facet | Bai, Ye Chen, Haonan Chen, Jitong Chen, Zhuo Deng, Yi Dong, Xiaohong Hantrakul, Lamtharn Hao, Weituo Huang, Qingqing Huang, Zhongyi Jia, Dongya La, Feihu Le, Duc Li, Bochen Li, Chumin Li, Hui Li, Xingxing Liu, Shouda Lu, Wei-Tsung Lu, Yiqing Shaw, Andrew Spijkervet, Janne Sun, Yakun Wang, Bo Wang, Ju-Chiang Wang, Yuping Wang, Yuxuan Xu, Ling Yang, Yifeng Yao, Chao Zhang, Shuo Zhang, Yang Zhang, Yilin Zhao, Hang Zhao, Ziyi Zhong, Dejian Zhou, Shicen Zou, Pei |
| contents | We introduce Seed-Music, a suite of music generation systems capable of producing high-quality music with fine-grained style control. Our unified framework leverages both auto-regressive language modeling and diffusion approaches to support two key music creation workflows: controlled music generation and post-production editing. For controlled music generation, our system enables vocal music generation with performance controls from multi-modal inputs, including style descriptions, audio references, musical scores, and voice prompts. For post-production editing, it offers interactive tools for editing lyrics and vocal melodies directly in the generated audio.
We encourage readers to listen to demo audio examples at https://team.doubao.com/seed-music "https://team.doubao.com/seed-music". |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_09214 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Seed-Music: A Unified Framework for High Quality and Controlled Music Generation Bai, Ye Chen, Haonan Chen, Jitong Chen, Zhuo Deng, Yi Dong, Xiaohong Hantrakul, Lamtharn Hao, Weituo Huang, Qingqing Huang, Zhongyi Jia, Dongya La, Feihu Le, Duc Li, Bochen Li, Chumin Li, Hui Li, Xingxing Liu, Shouda Lu, Wei-Tsung Lu, Yiqing Shaw, Andrew Spijkervet, Janne Sun, Yakun Wang, Bo Wang, Ju-Chiang Wang, Yuping Wang, Yuxuan Xu, Ling Yang, Yifeng Yao, Chao Zhang, Shuo Zhang, Yang Zhang, Yilin Zhao, Hang Zhao, Ziyi Zhong, Dejian Zhou, Shicen Zou, Pei Sound Audio and Speech Processing We introduce Seed-Music, a suite of music generation systems capable of producing high-quality music with fine-grained style control. Our unified framework leverages both auto-regressive language modeling and diffusion approaches to support two key music creation workflows: controlled music generation and post-production editing. For controlled music generation, our system enables vocal music generation with performance controls from multi-modal inputs, including style descriptions, audio references, musical scores, and voice prompts. For post-production editing, it offers interactive tools for editing lyrics and vocal melodies directly in the generated audio. We encourage readers to listen to demo audio examples at https://team.doubao.com/seed-music "https://team.doubao.com/seed-music". |
| title | Seed-Music: A Unified Framework for High Quality and Controlled Music Generation |
| topic | Sound Audio and Speech Processing |
| url | https://arxiv.org/abs/2409.09214 |