AVS-Net: Point Sampling with Adaptive Voxel Size for 3D Scene Understanding

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Yang, Hongcheng, Liang, Dingkang, Zhang, Dingyuan, Liu, Zhe, Zou, Zhikang, Jiang, Xingyu, Zhu, Yingying
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866913456902373376
author Yang, Hongcheng
Liang, Dingkang
Zhang, Dingyuan
Liu, Zhe
Zou, Zhikang
Jiang, Xingyu
Zhu, Yingying
author_facet Yang, Hongcheng
Liang, Dingkang
Zhang, Dingyuan
Liu, Zhe
Zou, Zhikang
Jiang, Xingyu
Zhu, Yingying
contents The recent advancements in point cloud learning have enabled intelligent vehicles and robots to comprehend 3D environments better. However, processing large-scale 3D scenes remains a challenging problem, such that efficient downsampling methods play a crucial role in point cloud learning. Existing downsampling methods either require a huge computational burden or sacrifice fine-grained geometric information. For such purpose, this paper presents an advanced sampler that achieves both high accuracy and efficiency. The proposed method utilizes voxel centroid sampling as a foundation but effectively addresses the challenges regarding voxel size determination and the preservation of critical geometric cues. Specifically, we propose a Voxel Adaptation Module that adaptively adjusts voxel sizes with the reference of point-based downsampling ratio. This ensures that the sampling results exhibit a favorable distribution for comprehending various 3D objects or scenes. Meanwhile, we introduce a network compatible with arbitrary voxel sizes for sampling and feature extraction while maintaining high efficiency. The proposed approach is demonstrated with 3D object detection and 3D semantic segmentation. Compared to existing state-of-the-art methods, our approach achieves better accuracy on outdoor and indoor large-scale datasets, e.g. Waymo and ScanNet, with promising efficiency.
format Preprint
id arxiv_https___arxiv_org_abs_2402_17521
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle AVS-Net: Point Sampling with Adaptive Voxel Size for 3D Scene Understanding
Yang, Hongcheng
Liang, Dingkang
Zhang, Dingyuan
Liu, Zhe
Zou, Zhikang
Jiang, Xingyu
Zhu, Yingying
Computer Vision and Pattern Recognition
The recent advancements in point cloud learning have enabled intelligent vehicles and robots to comprehend 3D environments better. However, processing large-scale 3D scenes remains a challenging problem, such that efficient downsampling methods play a crucial role in point cloud learning. Existing downsampling methods either require a huge computational burden or sacrifice fine-grained geometric information. For such purpose, this paper presents an advanced sampler that achieves both high accuracy and efficiency. The proposed method utilizes voxel centroid sampling as a foundation but effectively addresses the challenges regarding voxel size determination and the preservation of critical geometric cues. Specifically, we propose a Voxel Adaptation Module that adaptively adjusts voxel sizes with the reference of point-based downsampling ratio. This ensures that the sampling results exhibit a favorable distribution for comprehending various 3D objects or scenes. Meanwhile, we introduce a network compatible with arbitrary voxel sizes for sampling and feature extraction while maintaining high efficiency. The proposed approach is demonstrated with 3D object detection and 3D semantic segmentation. Compared to existing state-of-the-art methods, our approach achieves better accuracy on outdoor and indoor large-scale datasets, e.g. Waymo and ScanNet, with promising efficiency.
title AVS-Net: Point Sampling with Adaptive Voxel Size for 3D Scene Understanding
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2402.17521