Transformations in Learned Image Compression from a Modulation Perspective

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Bao, Youneng, Meng, Fangyang, Tan, Wen, Li, Chao, Tian, Yonghong, Liang, Yongsheng
Format: Preprint
Published: 2022
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916155983134720
author Bao, Youneng
Meng, Fangyang
Tan, Wen
Li, Chao
Tian, Yonghong
Liang, Yongsheng
author_facet Bao, Youneng
Meng, Fangyang
Tan, Wen
Li, Chao
Tian, Yonghong
Liang, Yongsheng
contents In this paper, a unified transformation method in learned image compression(LIC) is proposed from the perspective of modulation. Firstly, the quantization in LIC is considered as a generalized channel with additive uniform noise. Moreover, the LIC is interpreted as a particular communication system according to the consistency in structures and optimization objectives. Thus, the technology of communication systems can be applied to guide the design of modules in LIC. Furthermore, a unified transform method based on signal modulation (TSM) is defined. In the view of TSM, the existing transformation methods are mathematically reduced to a linear modulation. A series of transformation methods, e.g. TPM and TJM, are obtained by extending to nonlinear modulation. The experimental results on various datasets and backbone architectures verify that the effectiveness and robustness of the proposed method. More importantly, it further confirms the feasibility of guiding LIC design from a communication perspective. For example, when backbone architecture is hyperprior combining context model, our method achieves 3.52$\%$ BD-rate reduction over GDN on Kodak dataset without increasing complexity.
format Preprint
id arxiv_https___arxiv_org_abs_2203_02158
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Transformations in Learned Image Compression from a Modulation Perspective
Bao, Youneng
Meng, Fangyang
Tan, Wen
Li, Chao
Tian, Yonghong
Liang, Yongsheng
Image and Video Processing
Artificial Intelligence
Computer Vision and Pattern Recognition
In this paper, a unified transformation method in learned image compression(LIC) is proposed from the perspective of modulation. Firstly, the quantization in LIC is considered as a generalized channel with additive uniform noise. Moreover, the LIC is interpreted as a particular communication system according to the consistency in structures and optimization objectives. Thus, the technology of communication systems can be applied to guide the design of modules in LIC. Furthermore, a unified transform method based on signal modulation (TSM) is defined. In the view of TSM, the existing transformation methods are mathematically reduced to a linear modulation. A series of transformation methods, e.g. TPM and TJM, are obtained by extending to nonlinear modulation. The experimental results on various datasets and backbone architectures verify that the effectiveness and robustness of the proposed method. More importantly, it further confirms the feasibility of guiding LIC design from a communication perspective. For example, when backbone architecture is hyperprior combining context model, our method achieves 3.52$\%$ BD-rate reduction over GDN on Kodak dataset without increasing complexity.
title Transformations in Learned Image Compression from a Modulation Perspective
topic Image and Video Processing
Artificial Intelligence
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2203.02158