Saliency-aware End-to-end Learned Variable-Bitrate 360-degree Image Compression

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Gungordu, Oguzhan, Tekalp, A. Murat
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866929243116535808
author Gungordu, Oguzhan
Tekalp, A. Murat
author_facet Gungordu, Oguzhan
Tekalp, A. Murat
contents Effective compression of 360$^\circ$ images, also referred to as omnidirectional images (ODIs), is of high interest for various virtual reality (VR) and related applications. 2D image compression methods ignore the equator-biased nature of ODIs and fail to address oversampling near the poles, leading to inefficient compression when applied to ODI. We present a new learned saliency-aware 360$^\circ$ image compression architecture that prioritizes bit allocation to more significant regions, considering the unique properties of ODIs. By assigning fewer bits to less important regions, significant data size reduction can be achieved while maintaining high visual quality in the significant regions. To the best of our knowledge, this is the first study that proposes an end-to-end variable-rate model to compress 360$^\circ$ images leveraging saliency information. The results show significant bit-rate savings over the state-of-the-art learned and traditional ODI compression methods at similar perceptual visual quality.
format Preprint
id arxiv_https___arxiv_org_abs_2402_08862
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Saliency-aware End-to-end Learned Variable-Bitrate 360-degree Image Compression
Gungordu, Oguzhan
Tekalp, A. Murat
Image and Video Processing
Effective compression of 360$^\circ$ images, also referred to as omnidirectional images (ODIs), is of high interest for various virtual reality (VR) and related applications. 2D image compression methods ignore the equator-biased nature of ODIs and fail to address oversampling near the poles, leading to inefficient compression when applied to ODI. We present a new learned saliency-aware 360$^\circ$ image compression architecture that prioritizes bit allocation to more significant regions, considering the unique properties of ODIs. By assigning fewer bits to less important regions, significant data size reduction can be achieved while maintaining high visual quality in the significant regions. To the best of our knowledge, this is the first study that proposes an end-to-end variable-rate model to compress 360$^\circ$ images leveraging saliency information. The results show significant bit-rate savings over the state-of-the-art learned and traditional ODI compression methods at similar perceptual visual quality.
title Saliency-aware End-to-end Learned Variable-Bitrate 360-degree Image Compression
topic Image and Video Processing
url https://arxiv.org/abs/2402.08862