QuantVSR: Low-Bit Post-Training Quantization for Real-World Video Super-Resolution

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Chai, Bowen, Chen, Zheng, Zhu, Libo, Li, Wenbo, Guo, Yong, Zhang, Yulun
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866912876228247552
author Chai, Bowen
Chen, Zheng
Zhu, Libo
Li, Wenbo
Guo, Yong
Zhang, Yulun
author_facet Chai, Bowen
Chen, Zheng
Zhu, Libo
Li, Wenbo
Guo, Yong
Zhang, Yulun
contents Diffusion models have shown superior performance in real-world video super-resolution (VSR). However, the slow processing speeds and heavy resource consumption of diffusion models hinder their practical application and deployment. Quantization offers a potential solution for compressing the VSR model. Nevertheless, quantizing VSR models is challenging due to their temporal characteristics and high fidelity requirements. To address these issues, we propose QuantVSR, a low-bit quantization model for real-world VSR. We propose a spatio-temporal complexity aware (STCA) mechanism, where we first utilize the calibration dataset to measure both spatial and temporal complexities for each layer. Based on these statistics, we allocate layer-specific ranks to the low-rank full-precision (FP) auxiliary branch. Subsequently, we jointly refine the FP and low-bit branches to achieve simultaneous optimization. In addition, we propose a learnable bias alignment (LBA) module to reduce the biased quantization errors. Extensive experiments on synthetic and real-world datasets demonstrate that our method obtains comparable performance with the FP model and significantly outperforms recent leading low-bit quantization methods. Code is available at: https://github.com/bowenchai/QuantVSR.
format Preprint
id arxiv_https___arxiv_org_abs_2508_04485
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle QuantVSR: Low-Bit Post-Training Quantization for Real-World Video Super-Resolution
Chai, Bowen
Chen, Zheng
Zhu, Libo
Li, Wenbo
Guo, Yong
Zhang, Yulun
Computer Vision and Pattern Recognition
Diffusion models have shown superior performance in real-world video super-resolution (VSR). However, the slow processing speeds and heavy resource consumption of diffusion models hinder their practical application and deployment. Quantization offers a potential solution for compressing the VSR model. Nevertheless, quantizing VSR models is challenging due to their temporal characteristics and high fidelity requirements. To address these issues, we propose QuantVSR, a low-bit quantization model for real-world VSR. We propose a spatio-temporal complexity aware (STCA) mechanism, where we first utilize the calibration dataset to measure both spatial and temporal complexities for each layer. Based on these statistics, we allocate layer-specific ranks to the low-rank full-precision (FP) auxiliary branch. Subsequently, we jointly refine the FP and low-bit branches to achieve simultaneous optimization. In addition, we propose a learnable bias alignment (LBA) module to reduce the biased quantization errors. Extensive experiments on synthetic and real-world datasets demonstrate that our method obtains comparable performance with the FP model and significantly outperforms recent leading low-bit quantization methods. Code is available at: https://github.com/bowenchai/QuantVSR.
title QuantVSR: Low-Bit Post-Training Quantization for Real-World Video Super-Resolution
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2508.04485