A Survey: Spatiotemporal Consistency in Video Generation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yin, Zhiyu, Chen, Kehai, Bai, Xuefeng, Jiang, Ruili, Li, Juntao, Li, Hongdong, Liu, Jin, Xiang, Yang, Yu, Jun, Zhang, Min
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915804240412672
author Yin, Zhiyu
Chen, Kehai
Bai, Xuefeng
Jiang, Ruili
Li, Juntao
Li, Hongdong
Liu, Jin
Xiang, Yang
Yu, Jun
Zhang, Min
author_facet Yin, Zhiyu
Chen, Kehai
Bai, Xuefeng
Jiang, Ruili
Li, Juntao
Li, Hongdong
Liu, Jin
Xiang, Yang
Yu, Jun
Zhang, Min
contents Video generation aims to produce temporally coherent sequences of visual frames, representing a pivotal advancement in Artificial Intelligence Generated Content (AIGC). Compared to static image generation, video generation poses unique challenges: it demands not only high-quality individual frames but also strong temporal coherence to ensure consistency throughout the spatiotemporal sequence. Although research addressing spatiotemporal consistency in video generation has increased in recent years, systematic reviews focusing on this core issue remain relatively scarce. To fill this gap, this paper views the video generation task as a sequential sampling process from a high-dimensional spatiotemporal distribution, and further discusses spatiotemporal consistency. We provide a systematic review of the latest advancements in the field. The content spans multiple dimensions including generation models, feature representations, generation frameworks, post-processing techniques, training strategies, benchmarks and evaluation metrics, with a particular focus on the mechanisms and effectiveness of various methods in maintaining spatiotemporal consistency. Finally, this paper explores future research directions and potential challenges in this field, aiming to provide valuable insights for advancing video generation technology. The project link is https://github.com/Yin-Z-Y/A-Survey-Spatiotemporal-Consistency-in-Video-Generation.
format Preprint
id arxiv_https___arxiv_org_abs_2502_17863
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Survey: Spatiotemporal Consistency in Video Generation
Yin, Zhiyu
Chen, Kehai
Bai, Xuefeng
Jiang, Ruili
Li, Juntao
Li, Hongdong
Liu, Jin
Xiang, Yang
Yu, Jun
Zhang, Min
Computer Vision and Pattern Recognition
Artificial Intelligence
Video generation aims to produce temporally coherent sequences of visual frames, representing a pivotal advancement in Artificial Intelligence Generated Content (AIGC). Compared to static image generation, video generation poses unique challenges: it demands not only high-quality individual frames but also strong temporal coherence to ensure consistency throughout the spatiotemporal sequence. Although research addressing spatiotemporal consistency in video generation has increased in recent years, systematic reviews focusing on this core issue remain relatively scarce. To fill this gap, this paper views the video generation task as a sequential sampling process from a high-dimensional spatiotemporal distribution, and further discusses spatiotemporal consistency. We provide a systematic review of the latest advancements in the field. The content spans multiple dimensions including generation models, feature representations, generation frameworks, post-processing techniques, training strategies, benchmarks and evaluation metrics, with a particular focus on the mechanisms and effectiveness of various methods in maintaining spatiotemporal consistency. Finally, this paper explores future research directions and potential challenges in this field, aiming to provide valuable insights for advancing video generation technology. The project link is https://github.com/Yin-Z-Y/A-Survey-Spatiotemporal-Consistency-in-Video-Generation.
title A Survey: Spatiotemporal Consistency in Video Generation
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2502.17863