ScripTONES: Sentiment-Conditioned Music Generation for Movie Scripts
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913196119425024 |
|---|---|
| author | Veerendranath, Vishruth Masti, Vibha Gupta, Utkarsh Chaudhuri, Hrishit Srinivasa, Gowri |
| author_facet | Veerendranath, Vishruth Masti, Vibha Gupta, Utkarsh Chaudhuri, Hrishit Srinivasa, Gowri |
| contents | Film scores are considered an essential part of the film cinematic experience, but the process of film score generation is often expensive and infeasible for small-scale creators. Automating the process of film score composition would provide useful starting points for music in small projects. In this paper, we propose a two-stage pipeline for generating music from a movie script. The first phase is the Sentiment Analysis phase where the sentiment of a scene from the film script is encoded into the valence-arousal continuous space. The second phase is the Conditional Music Generation phase which takes as input the valence-arousal vector and conditionally generates piano MIDI music to match the sentiment. We study the efficacy of various music generation architectures by performing a qualitative user survey and propose methods to improve sentiment-conditioning in VAE architectures. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_07084 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | ScripTONES: Sentiment-Conditioned Music Generation for Movie Scripts Veerendranath, Vishruth Masti, Vibha Gupta, Utkarsh Chaudhuri, Hrishit Srinivasa, Gowri Multimedia Sound Audio and Speech Processing Film scores are considered an essential part of the film cinematic experience, but the process of film score generation is often expensive and infeasible for small-scale creators. Automating the process of film score composition would provide useful starting points for music in small projects. In this paper, we propose a two-stage pipeline for generating music from a movie script. The first phase is the Sentiment Analysis phase where the sentiment of a scene from the film script is encoded into the valence-arousal continuous space. The second phase is the Conditional Music Generation phase which takes as input the valence-arousal vector and conditionally generates piano MIDI music to match the sentiment. We study the efficacy of various music generation architectures by performing a qualitative user survey and propose methods to improve sentiment-conditioning in VAE architectures. |
| title | ScripTONES: Sentiment-Conditioned Music Generation for Movie Scripts |
| topic | Multimedia Sound Audio and Speech Processing |
| url | https://arxiv.org/abs/2401.07084 |