MemCam: Memory-Augmented Camera Control for Consistent Video Generation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Gao, Xinhang, Guan, Junlin, Luo, Shuhan, Li, Wenzhuo, Tan, Guanghuan, Wang, Jiacheng
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915894841573376
author Gao, Xinhang
Guan, Junlin
Luo, Shuhan
Li, Wenzhuo
Tan, Guanghuan
Wang, Jiacheng
author_facet Gao, Xinhang
Guan, Junlin
Luo, Shuhan
Li, Wenzhuo
Tan, Guanghuan
Wang, Jiacheng
contents Interactive video generation has significant potential for scene simulation and video creation. However, existing methods often struggle with maintaining scene consistency during long video generation under dynamic camera control due to limited contextual information. To address this challenge, we propose MemCam, a memory-augmented interactive video generation approach that treats previously generated frames as external memory and leverages them as contextual conditioning to achieve controllable camera viewpoints with high scene consistency. To enable longer and more relevant context, we design a context compression module that encodes memory frames into compact representations and employs co-visibility-based selection to dynamically retrieve the most relevant historical frames, thereby reducing computational overhead while enriching contextual information. Experiments on interactive video generation tasks show that MemCam significantly outperforms existing baseline methods as well as open-source state-of-the-art approaches in terms of scene consistency, particularly in long video scenarios with large camera rotations.
format Preprint
id arxiv_https___arxiv_org_abs_2603_26193
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle MemCam: Memory-Augmented Camera Control for Consistent Video Generation
Gao, Xinhang
Guan, Junlin
Luo, Shuhan
Li, Wenzhuo
Tan, Guanghuan
Wang, Jiacheng
Computer Vision and Pattern Recognition
Artificial Intelligence
Interactive video generation has significant potential for scene simulation and video creation. However, existing methods often struggle with maintaining scene consistency during long video generation under dynamic camera control due to limited contextual information. To address this challenge, we propose MemCam, a memory-augmented interactive video generation approach that treats previously generated frames as external memory and leverages them as contextual conditioning to achieve controllable camera viewpoints with high scene consistency. To enable longer and more relevant context, we design a context compression module that encodes memory frames into compact representations and employs co-visibility-based selection to dynamically retrieve the most relevant historical frames, thereby reducing computational overhead while enriching contextual information. Experiments on interactive video generation tasks show that MemCam significantly outperforms existing baseline methods as well as open-source state-of-the-art approaches in terms of scene consistency, particularly in long video scenarios with large camera rotations.
title MemCam: Memory-Augmented Camera Control for Consistent Video Generation
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2603.26193