MovieBench: A Hierarchical Movie Level Dataset for Long Video Generation
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909556628520960 |
|---|---|
| author | Wu, Weijia Liu, Mingyu Zhu, Zeyu Xia, Xi Feng, Haoen Wang, Wen Lin, Kevin Qinghong Shen, Chunhua Shou, Mike Zheng |
| author_facet | Wu, Weijia Liu, Mingyu Zhu, Zeyu Xia, Xi Feng, Haoen Wang, Wen Lin, Kevin Qinghong Shen, Chunhua Shou, Mike Zheng |
| contents | Recent advancements in video generation models, like Stable Video Diffusion, show promising results, but primarily focus on short, single-scene videos. These models struggle with generating long videos that involve multiple scenes, coherent narratives, and consistent characters. Furthermore, there is no publicly available dataset tailored for the analysis, evaluation, and training of long video generation models. In this paper, we present MovieBench: A Hierarchical Movie-Level Dataset for Long Video Generation, which addresses these challenges by providing unique contributions: (1) movie-length videos featuring rich, coherent storylines and multi-scene narratives, (2) consistency of character appearance and audio across scenes, and (3) hierarchical data structure contains high-level movie information and detailed shot-level descriptions. Experiments demonstrate that MovieBench brings some new insights and challenges, such as maintaining character ID consistency across multiple scenes for various characters. The dataset will be public and continuously maintained, aiming to advance the field of long video generation. Data can be found at: https://weijiawu.github.io/MovieBench/. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_15262 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | MovieBench: A Hierarchical Movie Level Dataset for Long Video Generation Wu, Weijia Liu, Mingyu Zhu, Zeyu Xia, Xi Feng, Haoen Wang, Wen Lin, Kevin Qinghong Shen, Chunhua Shou, Mike Zheng Computer Vision and Pattern Recognition Recent advancements in video generation models, like Stable Video Diffusion, show promising results, but primarily focus on short, single-scene videos. These models struggle with generating long videos that involve multiple scenes, coherent narratives, and consistent characters. Furthermore, there is no publicly available dataset tailored for the analysis, evaluation, and training of long video generation models. In this paper, we present MovieBench: A Hierarchical Movie-Level Dataset for Long Video Generation, which addresses these challenges by providing unique contributions: (1) movie-length videos featuring rich, coherent storylines and multi-scene narratives, (2) consistency of character appearance and audio across scenes, and (3) hierarchical data structure contains high-level movie information and detailed shot-level descriptions. Experiments demonstrate that MovieBench brings some new insights and challenges, such as maintaining character ID consistency across multiple scenes for various characters. The dataset will be public and continuously maintained, aiming to advance the field of long video generation. Data can be found at: https://weijiawu.github.io/MovieBench/. |
| title | MovieBench: A Hierarchical Movie Level Dataset for Long Video Generation |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2411.15262 |