Saved in:
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2601.03655 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866908751028551680 |
|---|---|
| author | Zhou, Jinsong Du, Yihua Xu, Xinli Wang, Luozhou Zhuang, Zijie Zhang, Yehang Li, Shuaibo Hu, Xiaojun Su, Bolan Chen, Ying-cong |
| author_facet | Zhou, Jinsong Du, Yihua Xu, Xinli Wang, Luozhou Zhuang, Zijie Zhang, Yehang Li, Shuaibo Hu, Xiaojun Su, Bolan Chen, Ying-cong |
| contents | Maintaining consistent characters, props, and environments across multiple shots is a central challenge in narrative video generation. Existing models can produce high-quality short clips but often fail to preserve entity identity and appearance when scenes change or when entities reappear after long temporal gaps. We present VideoMemory, an entity-centric framework that integrates narrative planning with visual generation through a Dynamic Memory Bank. Given a structured script, a multi-agent system decomposes the narrative into shots, retrieves entity representations from memory, and synthesizes keyframes and videos conditioned on these retrieved states. The Dynamic Memory Bank stores explicit visual and semantic descriptors for characters, props, and backgrounds, and is updated after each shot to reflect story-driven changes while preserving identity. This retrieval-update mechanism enables consistent portrayal of entities across distant shots and supports coherent long-form generation. To evaluate this setting, we construct a 54-case multi-shot consistency benchmark covering character-, prop-, and background-persistent scenarios. Extensive experiments show that VideoMemory achieves strong entity-level coherence and high perceptual quality across diverse narrative sequences. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_03655 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | VideoMemory: Toward Consistent Video Generation via Memory Integration Zhou, Jinsong Du, Yihua Xu, Xinli Wang, Luozhou Zhuang, Zijie Zhang, Yehang Li, Shuaibo Hu, Xiaojun Su, Bolan Chen, Ying-cong Computer Vision and Pattern Recognition Maintaining consistent characters, props, and environments across multiple shots is a central challenge in narrative video generation. Existing models can produce high-quality short clips but often fail to preserve entity identity and appearance when scenes change or when entities reappear after long temporal gaps. We present VideoMemory, an entity-centric framework that integrates narrative planning with visual generation through a Dynamic Memory Bank. Given a structured script, a multi-agent system decomposes the narrative into shots, retrieves entity representations from memory, and synthesizes keyframes and videos conditioned on these retrieved states. The Dynamic Memory Bank stores explicit visual and semantic descriptors for characters, props, and backgrounds, and is updated after each shot to reflect story-driven changes while preserving identity. This retrieval-update mechanism enables consistent portrayal of entities across distant shots and supports coherent long-form generation. To evaluate this setting, we construct a 54-case multi-shot consistency benchmark covering character-, prop-, and background-persistent scenarios. Extensive experiments show that VideoMemory achieves strong entity-level coherence and high perceptual quality across diverse narrative sequences. |
| title | VideoMemory: Toward Consistent Video Generation via Memory Integration |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2601.03655 |