HarmoQ: Harmonized Post-Training Quantization for High-Fidelity Image

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Wang, Hongjun, Chen, Jiyuan, Song, Xuan, Zheng, Yinqiang
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914149743722496
author Wang, Hongjun
Chen, Jiyuan
Song, Xuan
Zheng, Yinqiang
author_facet Wang, Hongjun
Chen, Jiyuan
Song, Xuan
Zheng, Yinqiang
contents Post-training quantization offers an efficient pathway to deploy super-resolution models, yet existing methods treat weight and activation quantization independently, missing their critical interplay. Through controlled experiments on SwinIR, we uncover a striking asymmetry: weight quantization primarily degrades structural similarity, while activation quantization disproportionately affects pixel-level accuracy. This stems from their distinct roles--weights encode learned restoration priors for textures and edges, whereas activations carry input-specific intensity information. Building on this insight, we propose HarmoQ, a unified framework that harmonizes quantization across components through three synergistic steps: structural residual calibration proactively adjusts weights to compensate for activation-induced detail loss, harmonized scale optimization analytically balances quantization difficulty via closed-form solutions, and adaptive boundary refinement iteratively maintains this balance during optimization. Experiments show HarmoQ achieves substantial gains under aggressive compression, outperforming prior art by 0.46 dB on Set5 at 2-bit while delivering 3.2x speedup and 4x memory reduction on A100 GPUs. This work provides the first systematic analysis of weight-activation coupling in super-resolution quantization and establishes a principled solution for efficient high-quality image restoration.
format Preprint
id arxiv_https___arxiv_org_abs_2511_05868
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle HarmoQ: Harmonized Post-Training Quantization for High-Fidelity Image
Wang, Hongjun
Chen, Jiyuan
Song, Xuan
Zheng, Yinqiang
Image and Video Processing
Computer Vision and Pattern Recognition
Post-training quantization offers an efficient pathway to deploy super-resolution models, yet existing methods treat weight and activation quantization independently, missing their critical interplay. Through controlled experiments on SwinIR, we uncover a striking asymmetry: weight quantization primarily degrades structural similarity, while activation quantization disproportionately affects pixel-level accuracy. This stems from their distinct roles--weights encode learned restoration priors for textures and edges, whereas activations carry input-specific intensity information. Building on this insight, we propose HarmoQ, a unified framework that harmonizes quantization across components through three synergistic steps: structural residual calibration proactively adjusts weights to compensate for activation-induced detail loss, harmonized scale optimization analytically balances quantization difficulty via closed-form solutions, and adaptive boundary refinement iteratively maintains this balance during optimization. Experiments show HarmoQ achieves substantial gains under aggressive compression, outperforming prior art by 0.46 dB on Set5 at 2-bit while delivering 3.2x speedup and 4x memory reduction on A100 GPUs. This work provides the first systematic analysis of weight-activation coupling in super-resolution quantization and establishes a principled solution for efficient high-quality image restoration.
title HarmoQ: Harmonized Post-Training Quantization for High-Fidelity Image
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2511.05868