Adaptive Video Distillation: Mitigating Oversaturation and Temporal Collapse in Few-Step Generation

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: You, Yuyang, Li, Yongzhi, Li, Jiahui, Mu, Yadong, Chen, Quan, Jiang, Peng
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866911538154045440
author You, Yuyang
Li, Yongzhi
Li, Jiahui
Mu, Yadong
Chen, Quan
Jiang, Peng
author_facet You, Yuyang
Li, Yongzhi
Li, Jiahui
Mu, Yadong
Chen, Quan
Jiang, Peng
contents Video generation has recently emerged as a central task in the field of generative AI. However, the substantial computational cost inherent in video synthesis makes model distillation a critical technique for efficient deployment. Despite its significance, there is a scarcity of methods specifically designed for video diffusion models. Prevailing approaches often directly adapt image distillation techniques, which frequently lead to artifacts such as oversaturation, temporal inconsistency, and mode collapse. To address these challenges, we propose a novel distillation framework tailored specifically for video diffusion models. Its core innovations include: (1) an adaptive regression loss that dynamically adjusts spatial supervision weights to prevent artifacts arising from excessive distribution shifts; (2) a temporal regularization loss to counteract temporal collapse, promoting smooth and physically plausible sampling trajectories; and (3) an inference-time frame interpolation strategy that reduces sampling overhead while preserving perceptual quality. Extensive experiments and ablation studies on the VBench and VBench2 benchmarks demonstrate that our method achieves stable few-step video synthesis, significantly enhancing perceptual fidelity and motion realism. It consistently outperforms existing distillation baselines across multiple metrics.
format Preprint
id arxiv_https___arxiv_org_abs_2603_21864
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Adaptive Video Distillation: Mitigating Oversaturation and Temporal Collapse in Few-Step Generation
You, Yuyang
Li, Yongzhi
Li, Jiahui
Mu, Yadong
Chen, Quan
Jiang, Peng
Computer Vision and Pattern Recognition
Artificial Intelligence
Video generation has recently emerged as a central task in the field of generative AI. However, the substantial computational cost inherent in video synthesis makes model distillation a critical technique for efficient deployment. Despite its significance, there is a scarcity of methods specifically designed for video diffusion models. Prevailing approaches often directly adapt image distillation techniques, which frequently lead to artifacts such as oversaturation, temporal inconsistency, and mode collapse. To address these challenges, we propose a novel distillation framework tailored specifically for video diffusion models. Its core innovations include: (1) an adaptive regression loss that dynamically adjusts spatial supervision weights to prevent artifacts arising from excessive distribution shifts; (2) a temporal regularization loss to counteract temporal collapse, promoting smooth and physically plausible sampling trajectories; and (3) an inference-time frame interpolation strategy that reduces sampling overhead while preserving perceptual quality. Extensive experiments and ablation studies on the VBench and VBench2 benchmarks demonstrate that our method achieves stable few-step video synthesis, significantly enhancing perceptual fidelity and motion realism. It consistently outperforms existing distillation baselines across multiple metrics.
title Adaptive Video Distillation: Mitigating Oversaturation and Temporal Collapse in Few-Step Generation
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2603.21864