A Comprehensive Survey on Generative AI for Video-to-Music Generation
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866912781067878400 |
|---|---|
| author | Ji, Shulei Wu, Songruoyao Wang, Zihao Li, Shuyu Zhang, Kejun |
| author_facet | Ji, Shulei Wu, Songruoyao Wang, Zihao Li, Shuyu Zhang, Kejun |
| contents | The burgeoning growth of video-to-music generation can be attributed to the ascendancy of multimodal generative models. However, there is a lack of literature that comprehensively combs through the work in this field. To fill this gap, this paper presents a comprehensive review of video-to-music generation using deep generative AI techniques, focusing on three key components: conditioning input construction, conditioning mechanism, and music generation frameworks. We categorize existing approaches based on their designs for each component, clarifying the roles of different strategies. Preceding this, we provide a fine-grained categorization of video and music modalities, illustrating how different categories influence the design of components within the generation pipelines. Furthermore, we summarize available multimodal datasets and evaluation metrics while highlighting ongoing challenges in the field. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_12489 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | A Comprehensive Survey on Generative AI for Video-to-Music Generation Ji, Shulei Wu, Songruoyao Wang, Zihao Li, Shuyu Zhang, Kejun Audio and Speech Processing Artificial Intelligence Multimedia The burgeoning growth of video-to-music generation can be attributed to the ascendancy of multimodal generative models. However, there is a lack of literature that comprehensively combs through the work in this field. To fill this gap, this paper presents a comprehensive review of video-to-music generation using deep generative AI techniques, focusing on three key components: conditioning input construction, conditioning mechanism, and music generation frameworks. We categorize existing approaches based on their designs for each component, clarifying the roles of different strategies. Preceding this, we provide a fine-grained categorization of video and music modalities, illustrating how different categories influence the design of components within the generation pipelines. Furthermore, we summarize available multimodal datasets and evaluation metrics while highlighting ongoing challenges in the field. |
| title | A Comprehensive Survey on Generative AI for Video-to-Music Generation |
| topic | Audio and Speech Processing Artificial Intelligence Multimedia |
| url | https://arxiv.org/abs/2502.12489 |