CurveCloudNet: Processing Point Clouds with 1D Structure

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Stearns, Colton, Rempe, Davis, Liu, Jiateng, Fu, Alex, Mascha, Sebastien, Park, Jeong Joon, Paschalidou, Despoina, Guibas, Leonidas J.
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929231273918464
author Stearns, Colton
Rempe, Davis
Liu, Jiateng
Fu, Alex
Mascha, Sebastien
Park, Jeong Joon
Paschalidou, Despoina
Guibas, Leonidas J.
author_facet Stearns, Colton
Rempe, Davis
Liu, Jiateng
Fu, Alex
Mascha, Sebastien
Park, Jeong Joon
Paschalidou, Despoina
Guibas, Leonidas J.
contents Modern depth sensors such as LiDAR operate by sweeping laser-beams across the scene, resulting in a point cloud with notable 1D curve-like structures. In this work, we introduce a new point cloud processing scheme and backbone, called CurveCloudNet, which takes advantage of the curve-like structure inherent to these sensors. While existing backbones discard the rich 1D traversal patterns and rely on generic 3D operations, CurveCloudNet parameterizes the point cloud as a collection of polylines (dubbed a "curve cloud"), establishing a local surface-aware ordering on the points. By reasoning along curves, CurveCloudNet captures lightweight curve-aware priors to efficiently and accurately reason in several diverse 3D environments. We evaluate CurveCloudNet on multiple synthetic and real datasets that exhibit distinct 3D size and structure. We demonstrate that CurveCloudNet outperforms both point-based and sparse-voxel backbones in various segmentation settings, notably scaling to large scenes better than point-based alternatives while exhibiting improved single-object performance over sparse-voxel alternatives. In all, CurveCloudNet is an efficient and accurate backbone that can handle a larger variety of 3D environments than past works.
format Preprint
id arxiv_https___arxiv_org_abs_2303_12050
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle CurveCloudNet: Processing Point Clouds with 1D Structure
Stearns, Colton
Rempe, Davis
Liu, Jiateng
Fu, Alex
Mascha, Sebastien
Park, Jeong Joon
Paschalidou, Despoina
Guibas, Leonidas J.
Computer Vision and Pattern Recognition
Modern depth sensors such as LiDAR operate by sweeping laser-beams across the scene, resulting in a point cloud with notable 1D curve-like structures. In this work, we introduce a new point cloud processing scheme and backbone, called CurveCloudNet, which takes advantage of the curve-like structure inherent to these sensors. While existing backbones discard the rich 1D traversal patterns and rely on generic 3D operations, CurveCloudNet parameterizes the point cloud as a collection of polylines (dubbed a "curve cloud"), establishing a local surface-aware ordering on the points. By reasoning along curves, CurveCloudNet captures lightweight curve-aware priors to efficiently and accurately reason in several diverse 3D environments. We evaluate CurveCloudNet on multiple synthetic and real datasets that exhibit distinct 3D size and structure. We demonstrate that CurveCloudNet outperforms both point-based and sparse-voxel backbones in various segmentation settings, notably scaling to large scenes better than point-based alternatives while exhibiting improved single-object performance over sparse-voxel alternatives. In all, CurveCloudNet is an efficient and accurate backbone that can handle a larger variety of 3D environments than past works.
title CurveCloudNet: Processing Point Clouds with 1D Structure
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2303.12050