SkyScript-100M: 1,000,000,000 Pairs of Scripts and Shooting Scripts for Short Drama
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866917760825556992 |
|---|---|
| author | Tang, Jing Jia, Quanlu Xie, Yuqiang Gong, Zeyu Wen, Xiang Zhang, Jiayi Guo, Yalong Chen, Guibin Yang, Jiangping |
| author_facet | Tang, Jing Jia, Quanlu Xie, Yuqiang Gong, Zeyu Wen, Xiang Zhang, Jiayi Guo, Yalong Chen, Guibin Yang, Jiangping |
| contents | Generating high-quality shooting scripts containing information such as scene and shot language is essential for short drama script generation. We collect 6,660 popular short drama episodes from the Internet, each with an average of 100 short episodes, and the total number of short episodes is about 80,000, with a total duration of about 2,000 hours and totaling 10 terabytes (TB). We perform keyframe extraction and annotation on each episode to obtain about 10,000,000 shooting scripts. We perform 100 script restorations on the extracted shooting scripts based on our self-developed large short drama generation model SkyReels. This leads to a dataset containing 1,000,000,000 pairs of scripts and shooting scripts for short dramas, called SkyScript-100M. We compare SkyScript-100M with the existing dataset in detail and demonstrate some deeper insights that can be achieved based on SkyScript-100M. Based on SkyScript-100M, researchers can achieve several deeper and more far-reaching script optimization goals, which may drive a paradigm shift in the entire field of text-to-video and significantly advance the field of short drama video generation. The data and code are available at https://github.com/vaew/SkyScript-100M. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_09333 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | SkyScript-100M: 1,000,000,000 Pairs of Scripts and Shooting Scripts for Short Drama Tang, Jing Jia, Quanlu Xie, Yuqiang Gong, Zeyu Wen, Xiang Zhang, Jiayi Guo, Yalong Chen, Guibin Yang, Jiangping Computation and Language Generating high-quality shooting scripts containing information such as scene and shot language is essential for short drama script generation. We collect 6,660 popular short drama episodes from the Internet, each with an average of 100 short episodes, and the total number of short episodes is about 80,000, with a total duration of about 2,000 hours and totaling 10 terabytes (TB). We perform keyframe extraction and annotation on each episode to obtain about 10,000,000 shooting scripts. We perform 100 script restorations on the extracted shooting scripts based on our self-developed large short drama generation model SkyReels. This leads to a dataset containing 1,000,000,000 pairs of scripts and shooting scripts for short dramas, called SkyScript-100M. We compare SkyScript-100M with the existing dataset in detail and demonstrate some deeper insights that can be achieved based on SkyScript-100M. Based on SkyScript-100M, researchers can achieve several deeper and more far-reaching script optimization goals, which may drive a paradigm shift in the entire field of text-to-video and significantly advance the field of short drama video generation. The data and code are available at https://github.com/vaew/SkyScript-100M. |
| title | SkyScript-100M: 1,000,000,000 Pairs of Scripts and Shooting Scripts for Short Drama |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2408.09333 |