Memory-V2V: Memory-Augmented Video-to-Video Diffusion for Consistent Multi-Turn Editing

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Lee, Dohun, Huang, Chun-Hao Paul, Chen, Xuelin, Ye, Jong Chul, Ceylan, Duygu, Jeong, Hyeonho
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915882863689728
author Lee, Dohun
Huang, Chun-Hao Paul
Chen, Xuelin
Ye, Jong Chul
Ceylan, Duygu
Jeong, Hyeonho
author_facet Lee, Dohun
Huang, Chun-Hao Paul
Chen, Xuelin
Ye, Jong Chul
Ceylan, Duygu
Jeong, Hyeonho
contents Video-to-video diffusion models achieve impressive single-turn editing performance, but practical editing workflows are inherently iterative. When edits are applied sequentially, existing models treat each turn independently, often causing previously generated regions to drift or be overwritten. We identify this failure mode as the problem of cross-turn consistency in multi-turn video editing. We introduce Memory-V2V, a memory-augmented framework that treats prior edits as structured constraints for subsequent generations. Memory-V2V maintains an external memory of previous outputs, retrieves task-relevant edits, and integrates them through relevance-aware tokenization and adaptive compression. These technical ingredients enable scalable conditioning without linear growth in computation. We demonstrate Memory-V2V on iterative video novel view synthesis and text-guided long video editing. Memory-V2V substantially enhances cross-turn consistency while maintaining visual quality, outperforming strong baselines with modest overhead.
format Preprint
id arxiv_https___arxiv_org_abs_2601_16296
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Memory-V2V: Memory-Augmented Video-to-Video Diffusion for Consistent Multi-Turn Editing
Lee, Dohun
Huang, Chun-Hao Paul
Chen, Xuelin
Ye, Jong Chul
Ceylan, Duygu
Jeong, Hyeonho
Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
Video-to-video diffusion models achieve impressive single-turn editing performance, but practical editing workflows are inherently iterative. When edits are applied sequentially, existing models treat each turn independently, often causing previously generated regions to drift or be overwritten. We identify this failure mode as the problem of cross-turn consistency in multi-turn video editing. We introduce Memory-V2V, a memory-augmented framework that treats prior edits as structured constraints for subsequent generations. Memory-V2V maintains an external memory of previous outputs, retrieves task-relevant edits, and integrates them through relevance-aware tokenization and adaptive compression. These technical ingredients enable scalable conditioning without linear growth in computation. We demonstrate Memory-V2V on iterative video novel view synthesis and text-guided long video editing. Memory-V2V substantially enhances cross-turn consistency while maintaining visual quality, outperforming strong baselines with modest overhead.
title Memory-V2V: Memory-Augmented Video-to-Video Diffusion for Consistent Multi-Turn Editing
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2601.16296