DiffCom: Decoupled Sparse Priors Guided Diffusion Compression for Point Clouds

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhang, Xiaoge, Wu, Zijie, Nasim, Mehwish, Feng, Mingtao, Anwar, Saeed, Mian, Ajmal
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908578501099520
author Zhang, Xiaoge
Wu, Zijie
Nasim, Mehwish
Feng, Mingtao
Anwar, Saeed
Mian, Ajmal
author_facet Zhang, Xiaoge
Wu, Zijie
Nasim, Mehwish
Feng, Mingtao
Anwar, Saeed
Mian, Ajmal
contents Lossy compression relies on an autoencoder to transform a point cloud into latent points for storage, leaving the inherent redundancy of latent representations unexplored. To reduce redundancy in latent points, we propose a diffusion-based framework guided by sparse priors that achieves high reconstruction quality, especially at low bitrates. Our approach features an efficient dual-density data flow that relaxes size constraints on latent points. It hybridizes a probabilistic conditional diffusion model to encapsulate essential details for reconstruction within sparse priors, which are decoupled hierarchically into intra- and inter-point priors. Specifically, our DiffCom encodes the original point cloud into latent points and decoupled sparse priors through separate encoders. To dynamically attend to geometric and semantic cues from the priors at each encoding and decoding layer, we employ an attention-guided latent denoiser conditioned on the decoupled priors. Additionally, we integrate the local distribution into the arithmetic encoder and decoder to enhance local context modeling of the sparse points. The original point cloud is reconstructed through a point decoder. Compared to state-of-the-art methods, our approach achieves a superior rate-distortion trade-off, as evidenced by extensive evaluations on the ShapeNet dataset and standard test datasets from the MPEG PCC Group.
format Preprint
id arxiv_https___arxiv_org_abs_2411_13860
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle DiffCom: Decoupled Sparse Priors Guided Diffusion Compression for Point Clouds
Zhang, Xiaoge
Wu, Zijie
Nasim, Mehwish
Feng, Mingtao
Anwar, Saeed
Mian, Ajmal
Computer Vision and Pattern Recognition
Image and Video Processing
Lossy compression relies on an autoencoder to transform a point cloud into latent points for storage, leaving the inherent redundancy of latent representations unexplored. To reduce redundancy in latent points, we propose a diffusion-based framework guided by sparse priors that achieves high reconstruction quality, especially at low bitrates. Our approach features an efficient dual-density data flow that relaxes size constraints on latent points. It hybridizes a probabilistic conditional diffusion model to encapsulate essential details for reconstruction within sparse priors, which are decoupled hierarchically into intra- and inter-point priors. Specifically, our DiffCom encodes the original point cloud into latent points and decoupled sparse priors through separate encoders. To dynamically attend to geometric and semantic cues from the priors at each encoding and decoding layer, we employ an attention-guided latent denoiser conditioned on the decoupled priors. Additionally, we integrate the local distribution into the arithmetic encoder and decoder to enhance local context modeling of the sparse points. The original point cloud is reconstructed through a point decoder. Compared to state-of-the-art methods, our approach achieves a superior rate-distortion trade-off, as evidenced by extensive evaluations on the ShapeNet dataset and standard test datasets from the MPEG PCC Group.
title DiffCom: Decoupled Sparse Priors Guided Diffusion Compression for Point Clouds
topic Computer Vision and Pattern Recognition
Image and Video Processing
url https://arxiv.org/abs/2411.13860