Controllable Distortion-Perception Tradeoff Through Latent Diffusion for Neural Image Compression
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866909430215344128 |
|---|---|
| author | Zhou, Chuqin Lu, Guo Li, Jiangchuan Chen, Xiangyu Cheng, Zhengxue Song, Li Zhang, Wenjun |
| author_facet | Zhou, Chuqin Lu, Guo Li, Jiangchuan Chen, Xiangyu Cheng, Zhengxue Song, Li Zhang, Wenjun |
| contents | Neural image compression often faces a challenging trade-off among rate, distortion and perception. While most existing methods typically focus on either achieving high pixel-level fidelity or optimizing for perceptual metrics, we propose a novel approach that simultaneously addresses both aspects for a fixed neural image codec. Specifically, we introduce a plug-and-play module at the decoder side that leverages a latent diffusion process to transform the decoded features, enhancing either low distortion or high perceptual quality without altering the original image compression codec. Our approach facilitates fusion of original and transformed features without additional training, enabling users to flexibly adjust the balance between distortion and perception during inference. Extensive experimental results demonstrate that our method significantly enhances the pretrained codecs with a wide, adjustable distortion-perception range while maintaining their original compression capabilities. For instance, we can achieve more than 150% improvement in LPIPS-BDRate without sacrificing more than 1 dB in PSNR. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_11379 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Controllable Distortion-Perception Tradeoff Through Latent Diffusion for Neural Image Compression Zhou, Chuqin Lu, Guo Li, Jiangchuan Chen, Xiangyu Cheng, Zhengxue Song, Li Zhang, Wenjun Image and Video Processing Computer Vision and Pattern Recognition Neural image compression often faces a challenging trade-off among rate, distortion and perception. While most existing methods typically focus on either achieving high pixel-level fidelity or optimizing for perceptual metrics, we propose a novel approach that simultaneously addresses both aspects for a fixed neural image codec. Specifically, we introduce a plug-and-play module at the decoder side that leverages a latent diffusion process to transform the decoded features, enhancing either low distortion or high perceptual quality without altering the original image compression codec. Our approach facilitates fusion of original and transformed features without additional training, enabling users to flexibly adjust the balance between distortion and perception during inference. Extensive experimental results demonstrate that our method significantly enhances the pretrained codecs with a wide, adjustable distortion-perception range while maintaining their original compression capabilities. For instance, we can achieve more than 150% improvement in LPIPS-BDRate without sacrificing more than 1 dB in PSNR. |
| title | Controllable Distortion-Perception Tradeoff Through Latent Diffusion for Neural Image Compression |
| topic | Image and Video Processing Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2412.11379 |