OneStory: Coherent Multi-Shot Video Generation with Adaptive Memory
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866908698502234112 |
|---|---|
| author | An, Zhaochong Jia, Menglin Qiu, Haonan Zhou, Zijian Huang, Xiaoke Liu, Zhiheng Ren, Weiming Kahatapitiya, Kumara Liu, Ding He, Sen Zhang, Chenyang Xiang, Tao Yang, Fanny Belongie, Serge Xie, Tian |
| author_facet | An, Zhaochong Jia, Menglin Qiu, Haonan Zhou, Zijian Huang, Xiaoke Liu, Zhiheng Ren, Weiming Kahatapitiya, Kumara Liu, Ding He, Sen Zhang, Chenyang Xiang, Tao Yang, Fanny Belongie, Serge Xie, Tian |
| contents | Storytelling in real-world videos often unfolds through multiple shots -- discontinuous yet semantically connected clips that together convey a coherent narrative. However, existing multi-shot video generation (MSV) methods struggle to effectively model long-range cross-shot context, as they rely on limited temporal windows or single keyframe conditioning, leading to degraded performance under complex narratives. In this work, we propose OneStory, enabling global yet compact cross-shot context modeling for consistent and scalable narrative generation. OneStory reformulates MSV as a next-shot generation task, enabling autoregressive shot synthesis while leveraging pretrained image-to-video (I2V) models for strong visual conditioning. We introduce two key modules: a Frame Selection module that constructs a semantically-relevant global memory based on informative frames from prior shots, and an Adaptive Conditioner that performs importance-guided patchification to generate compact context for direct conditioning. We further curate a high-quality multi-shot dataset with referential captions to mirror real-world storytelling patterns, and design effective training strategies under the next-shot paradigm. Finetuned from a pretrained I2V model on our curated 60K dataset, OneStory achieves state-of-the-art narrative coherence across diverse and complex scenes in both text- and image-conditioned settings, enabling controllable and immersive long-form video storytelling. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2512_07802 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | OneStory: Coherent Multi-Shot Video Generation with Adaptive Memory An, Zhaochong Jia, Menglin Qiu, Haonan Zhou, Zijian Huang, Xiaoke Liu, Zhiheng Ren, Weiming Kahatapitiya, Kumara Liu, Ding He, Sen Zhang, Chenyang Xiang, Tao Yang, Fanny Belongie, Serge Xie, Tian Computer Vision and Pattern Recognition Storytelling in real-world videos often unfolds through multiple shots -- discontinuous yet semantically connected clips that together convey a coherent narrative. However, existing multi-shot video generation (MSV) methods struggle to effectively model long-range cross-shot context, as they rely on limited temporal windows or single keyframe conditioning, leading to degraded performance under complex narratives. In this work, we propose OneStory, enabling global yet compact cross-shot context modeling for consistent and scalable narrative generation. OneStory reformulates MSV as a next-shot generation task, enabling autoregressive shot synthesis while leveraging pretrained image-to-video (I2V) models for strong visual conditioning. We introduce two key modules: a Frame Selection module that constructs a semantically-relevant global memory based on informative frames from prior shots, and an Adaptive Conditioner that performs importance-guided patchification to generate compact context for direct conditioning. We further curate a high-quality multi-shot dataset with referential captions to mirror real-world storytelling patterns, and design effective training strategies under the next-shot paradigm. Finetuned from a pretrained I2V model on our curated 60K dataset, OneStory achieves state-of-the-art narrative coherence across diverse and complex scenes in both text- and image-conditioned settings, enabling controllable and immersive long-form video storytelling. |
| title | OneStory: Coherent Multi-Shot Video Generation with Adaptive Memory |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2512.07802 |