Semantically Structured Image Compression via Irregular Group-Based Decoupling

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Feng, Ruoyu, Gao, Yixin, Jin, Xin, Feng, Runsen, Chen, Zhibo
Formato: Preprint
Publicado: 2023
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866913713407131648
author Feng, Ruoyu
Gao, Yixin
Jin, Xin
Feng, Runsen
Chen, Zhibo
author_facet Feng, Ruoyu
Gao, Yixin
Jin, Xin
Feng, Runsen
Chen, Zhibo
contents Image compression techniques typically focus on compressing rectangular images for human consumption, however, resulting in transmitting redundant content for downstream applications. To overcome this limitation, some previous works propose to semantically structure the bitstream, which can meet specific application requirements by selective transmission and reconstruction. Nevertheless, they divide the input image into multiple rectangular regions according to semantics and ignore avoiding information interaction among them, causing waste of bitrate and distorted reconstruction of region boundaries. In this paper, we propose to decouple an image into multiple groups with irregular shapes based on a customized group mask and compress them independently. Our group mask describes the image at a finer granularity, enabling significant bitrate saving by reducing the transmission of redundant content. Moreover, to ensure the fidelity of selective reconstruction, this paper proposes the concept of group-independent transform that maintain the independence among distinct groups. And we instantiate it by the proposed Group-Independent Swin-Block (GI Swin-Block). Experimental results demonstrate that our framework structures the bitstream with negligible cost, and exhibits superior performance on both visual quality and intelligent task supporting.
format Preprint
id arxiv_https___arxiv_org_abs_2305_02586
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Semantically Structured Image Compression via Irregular Group-Based Decoupling
Feng, Ruoyu
Gao, Yixin
Jin, Xin
Feng, Runsen
Chen, Zhibo
Image and Video Processing
Computer Vision and Pattern Recognition
Image compression techniques typically focus on compressing rectangular images for human consumption, however, resulting in transmitting redundant content for downstream applications. To overcome this limitation, some previous works propose to semantically structure the bitstream, which can meet specific application requirements by selective transmission and reconstruction. Nevertheless, they divide the input image into multiple rectangular regions according to semantics and ignore avoiding information interaction among them, causing waste of bitrate and distorted reconstruction of region boundaries. In this paper, we propose to decouple an image into multiple groups with irregular shapes based on a customized group mask and compress them independently. Our group mask describes the image at a finer granularity, enabling significant bitrate saving by reducing the transmission of redundant content. Moreover, to ensure the fidelity of selective reconstruction, this paper proposes the concept of group-independent transform that maintain the independence among distinct groups. And we instantiate it by the proposed Group-Independent Swin-Block (GI Swin-Block). Experimental results demonstrate that our framework structures the bitstream with negligible cost, and exhibits superior performance on both visual quality and intelligent task supporting.
title Semantically Structured Image Compression via Irregular Group-Based Decoupling
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2305.02586