Less is Enough: Training-Free Video Diffusion Acceleration via Runtime-Adaptive Caching

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Zhou, Xin, Liang, Dingkang, Chen, Kaijin, Feng, Tianrui, Chen, Xiwu, Lin, Hongkai, Ding, Yikang, Tan, Feiyang, Zhao, Hengshuang, Bai, Xiang
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912463035826176
author Zhou, Xin
Liang, Dingkang
Chen, Kaijin
Feng, Tianrui
Chen, Xiwu
Lin, Hongkai
Ding, Yikang
Tan, Feiyang
Zhao, Hengshuang
Bai, Xiang
author_facet Zhou, Xin
Liang, Dingkang
Chen, Kaijin
Feng, Tianrui
Chen, Xiwu
Lin, Hongkai
Ding, Yikang
Tan, Feiyang
Zhao, Hengshuang
Bai, Xiang
contents Video generation models have demonstrated remarkable performance, yet their broader adoption remains constrained by slow inference speeds and substantial computational costs, primarily due to the iterative nature of the denoising process. Addressing this bottleneck is essential for democratizing advanced video synthesis technologies and enabling their integration into real-world applications. This work proposes EasyCache, a training-free acceleration framework for video diffusion models. EasyCache introduces a lightweight, runtime-adaptive caching mechanism that dynamically reuses previously computed transformation vectors, avoiding redundant computations during inference. Unlike prior approaches, EasyCache requires no offline profiling, pre-computation, or extensive parameter tuning. We conduct comprehensive studies on various large-scale video generation models, including OpenSora, Wan2.1, and HunyuanVideo. Our method achieves leading acceleration performance, reducing inference time by up to 2.1-3.3$\times$ compared to the original baselines while maintaining high visual fidelity with a significant up to 36% PSNR improvement compared to the previous SOTA method. This improvement makes our EasyCache a efficient and highly accessible solution for high-quality video generation in both research and practical applications. The code is available at https://github.com/H-EmbodVis/EasyCache.
format Preprint
id arxiv_https___arxiv_org_abs_2507_02860
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Less is Enough: Training-Free Video Diffusion Acceleration via Runtime-Adaptive Caching
Zhou, Xin
Liang, Dingkang
Chen, Kaijin
Feng, Tianrui
Chen, Xiwu
Lin, Hongkai
Ding, Yikang
Tan, Feiyang
Zhao, Hengshuang
Bai, Xiang
Computer Vision and Pattern Recognition
Video generation models have demonstrated remarkable performance, yet their broader adoption remains constrained by slow inference speeds and substantial computational costs, primarily due to the iterative nature of the denoising process. Addressing this bottleneck is essential for democratizing advanced video synthesis technologies and enabling their integration into real-world applications. This work proposes EasyCache, a training-free acceleration framework for video diffusion models. EasyCache introduces a lightweight, runtime-adaptive caching mechanism that dynamically reuses previously computed transformation vectors, avoiding redundant computations during inference. Unlike prior approaches, EasyCache requires no offline profiling, pre-computation, or extensive parameter tuning. We conduct comprehensive studies on various large-scale video generation models, including OpenSora, Wan2.1, and HunyuanVideo. Our method achieves leading acceleration performance, reducing inference time by up to 2.1-3.3$\times$ compared to the original baselines while maintaining high visual fidelity with a significant up to 36% PSNR improvement compared to the previous SOTA method. This improvement makes our EasyCache a efficient and highly accessible solution for high-quality video generation in both research and practical applications. The code is available at https://github.com/H-EmbodVis/EasyCache.
title Less is Enough: Training-Free Video Diffusion Acceleration via Runtime-Adaptive Caching
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2507.02860