Implicit Neural Compression of Point Clouds

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Ruan, Hongning, Shao, Yulin, Yang, Qianqian, Zhao, Liang, Zhang, Zhaoyang, Niyato, Dusit
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909028565647360
author Ruan, Hongning
Shao, Yulin
Yang, Qianqian
Zhao, Liang
Zhang, Zhaoyang
Niyato, Dusit
author_facet Ruan, Hongning
Shao, Yulin
Yang, Qianqian
Zhao, Liang
Zhang, Zhaoyang
Niyato, Dusit
contents Point clouds have gained prominence across numerous applications due to their ability to accurately represent 3D objects and scenes. However, efficiently compressing unstructured, high-precision point cloud data remains a significant challenge. In this paper, we propose NeRC$^3$, a novel point cloud compression framework that leverages implicit neural representations (INRs) to encode both geometry and attributes of dense point clouds. Our approach employs two coordinate-based neural networks: one maps spatial coordinates to voxel occupancy, while the other maps occupied voxels to their attributes, thereby implicitly representing the geometry and attributes of a voxelized point cloud. The encoder quantizes and compresses network parameters alongside auxiliary information required for reconstruction, while the decoder reconstructs the original point cloud by inputting voxel coordinates into the neural networks. Furthermore, we extend our method to dynamic point cloud compression through techniques that reduce temporal redundancy, including a 4D spatio-temporal representation termed 4D-NeRC$^3$. Experimental results validate the effectiveness of our approach: For static point clouds, NeRC$^3$ outperforms octree-based G-PCC standard and existing INR-based methods. For dynamic point clouds, 4D-NeRC$^3$ achieves superior geometry compression performance compared to the latest G-PCC and V-PCC standards, while matching state-of-the-art learning-based methods. It also demonstrates competitive performance in joint geometry and attribute compression.
format Preprint
id arxiv_https___arxiv_org_abs_2412_10433
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Implicit Neural Compression of Point Clouds
Ruan, Hongning
Shao, Yulin
Yang, Qianqian
Zhao, Liang
Zhang, Zhaoyang
Niyato, Dusit
Computer Vision and Pattern Recognition
Machine Learning
Signal Processing
Point clouds have gained prominence across numerous applications due to their ability to accurately represent 3D objects and scenes. However, efficiently compressing unstructured, high-precision point cloud data remains a significant challenge. In this paper, we propose NeRC$^3$, a novel point cloud compression framework that leverages implicit neural representations (INRs) to encode both geometry and attributes of dense point clouds. Our approach employs two coordinate-based neural networks: one maps spatial coordinates to voxel occupancy, while the other maps occupied voxels to their attributes, thereby implicitly representing the geometry and attributes of a voxelized point cloud. The encoder quantizes and compresses network parameters alongside auxiliary information required for reconstruction, while the decoder reconstructs the original point cloud by inputting voxel coordinates into the neural networks. Furthermore, we extend our method to dynamic point cloud compression through techniques that reduce temporal redundancy, including a 4D spatio-temporal representation termed 4D-NeRC$^3$. Experimental results validate the effectiveness of our approach: For static point clouds, NeRC$^3$ outperforms octree-based G-PCC standard and existing INR-based methods. For dynamic point clouds, 4D-NeRC$^3$ achieves superior geometry compression performance compared to the latest G-PCC and V-PCC standards, while matching state-of-the-art learning-based methods. It also demonstrates competitive performance in joint geometry and attribute compression.
title Implicit Neural Compression of Point Clouds
topic Computer Vision and Pattern Recognition
Machine Learning
Signal Processing
url https://arxiv.org/abs/2412.10433