InfVSR: Toward Consistency-Driven Streaming Generative Video Super-Resolution

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Zhang, Ziqing, Liu, Kai, Chen, Zheng, Li, Xi, Chen, Yucong, Duan, Bingnan, Kong, Linghe, Zhang, Yulun
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866918517096316928
author Zhang, Ziqing
Liu, Kai
Chen, Zheng
Li, Xi
Chen, Yucong
Duan, Bingnan
Kong, Linghe
Zhang, Yulun
author_facet Zhang, Ziqing
Liu, Kai
Chen, Zheng
Li, Xi
Chen, Yucong
Duan, Bingnan
Kong, Linghe
Zhang, Yulun
contents Real-world videos often extend over thousands of frames. Existing generative video super-resolution (VSR) approaches, however, face two persistent challenges when processing long sequences: (1) inefficiency due to the heavy cost of multi-step denoising for full-length sequences; and (2) poor consistency is hindered by temporal decomposition that causes artifacts and discontinuities. To break these limits, we propose InfVSR, which reformulates VSR as an autoregressive-one-step-diffusion paradigm, and enables streaming inference with video diffusion priors. First, we adapt the pretrained DiT into a causal structure, maintaining both local and global coherence via rolling KV-cache and joint visual guidance. Second, we distill the diffusion process into a single step efficiently, with patch-wise pixel supervision and cross-chunk distribution matching. To fill the gap in long-form video evaluation, we build a new benchmark tailored for extended sequences and further introduce semantic-level metrics to comprehensively assess temporal consistency. Our method pushes the frontier of long-form VSR, achieves state-of-the-art quality with enhanced semantic consistency, and delivers up to 58x speed-up over existing methods such as MGLD-VSR. Our code and models are available at https://github.com/Kai-Liu001/InfVSR.
format Preprint
id arxiv_https___arxiv_org_abs_2510_00948
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle InfVSR: Toward Consistency-Driven Streaming Generative Video Super-Resolution
Zhang, Ziqing
Liu, Kai
Chen, Zheng
Li, Xi
Chen, Yucong
Duan, Bingnan
Kong, Linghe
Zhang, Yulun
Computer Vision and Pattern Recognition
Real-world videos often extend over thousands of frames. Existing generative video super-resolution (VSR) approaches, however, face two persistent challenges when processing long sequences: (1) inefficiency due to the heavy cost of multi-step denoising for full-length sequences; and (2) poor consistency is hindered by temporal decomposition that causes artifacts and discontinuities. To break these limits, we propose InfVSR, which reformulates VSR as an autoregressive-one-step-diffusion paradigm, and enables streaming inference with video diffusion priors. First, we adapt the pretrained DiT into a causal structure, maintaining both local and global coherence via rolling KV-cache and joint visual guidance. Second, we distill the diffusion process into a single step efficiently, with patch-wise pixel supervision and cross-chunk distribution matching. To fill the gap in long-form video evaluation, we build a new benchmark tailored for extended sequences and further introduce semantic-level metrics to comprehensively assess temporal consistency. Our method pushes the frontier of long-form VSR, achieves state-of-the-art quality with enhanced semantic consistency, and delivers up to 58x speed-up over existing methods such as MGLD-VSR. Our code and models are available at https://github.com/Kai-Liu001/InfVSR.
title InfVSR: Toward Consistency-Driven Streaming Generative Video Super-Resolution
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2510.00948