Saved in:
Bibliographic Details
Main Authors: Xie, Zhifei, Tang, Daniel, Tan, Dingwei, Klein, Jacques, Bissyand, Tegawend F., Ezzini, Saad
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2408.11788
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • Current video generation models excel at creating short, realistic clips, but struggle with longer, multi-scene videos. We introduce \texttt{DreamFactory}, an LLM-based framework that tackles this challenge. \texttt{DreamFactory} leverages multi-agent collaboration principles and a Key Frames Iteration Design Method to ensure consistency and style across long videos. It utilizes Chain of Thought (COT) to address uncertainties inherent in large language models. \texttt{DreamFactory} generates long, stylistically coherent, and complex videos. Evaluating these long-form videos presents a challenge. We propose novel metrics such as Cross-Scene Face Distance Score and Cross-Scene Style Consistency Score. To further research in this area, we contribute the Multi-Scene Videos Dataset containing over 150 human-rated videos.