PIDS: Joint Point Interaction-Dimension Search for 3D Point Cloud

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Zhang, Tunhou, Ma, Mingyuan, Yan, Feng, Li, Hai, Chen, Yiran
Natura: Preprint
Pubblicazione: 2022
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917566803345408
author Zhang, Tunhou
Ma, Mingyuan
Yan, Feng
Li, Hai
Chen, Yiran
author_facet Zhang, Tunhou
Ma, Mingyuan
Yan, Feng
Li, Hai
Chen, Yiran
contents The interaction and dimension of points are two important axes in designing point operators to serve hierarchical 3D models. Yet, these two axes are heterogeneous and challenging to fully explore. Existing works craft point operator under a single axis and reuse the crafted operator in all parts of 3D models. This overlooks the opportunity to better combine point interactions and dimensions by exploiting varying geometry/density of 3D point clouds. In this work, we establish PIDS, a novel paradigm to jointly explore point interactions and point dimensions to serve semantic segmentation on point cloud data. We establish a large search space to jointly consider versatile point interactions and point dimensions. This supports point operators with various geometry/density considerations. The enlarged search space with heterogeneous search components calls for a better ranking of candidate models. To achieve this, we improve the search space exploration by leveraging predictor-based Neural Architecture Search (NAS), and enhance the quality of prediction by assigning unique encoding to heterogeneous search components based on their priors. We thoroughly evaluate the networks crafted by PIDS on two semantic segmentation benchmarks, showing ~1% mIOU improvement on SemanticKITTI and S3DIS over state-of-the-art 3D models.
format Preprint
id arxiv_https___arxiv_org_abs_2211_15759
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle PIDS: Joint Point Interaction-Dimension Search for 3D Point Cloud
Zhang, Tunhou
Ma, Mingyuan
Yan, Feng
Li, Hai
Chen, Yiran
Computer Vision and Pattern Recognition
The interaction and dimension of points are two important axes in designing point operators to serve hierarchical 3D models. Yet, these two axes are heterogeneous and challenging to fully explore. Existing works craft point operator under a single axis and reuse the crafted operator in all parts of 3D models. This overlooks the opportunity to better combine point interactions and dimensions by exploiting varying geometry/density of 3D point clouds. In this work, we establish PIDS, a novel paradigm to jointly explore point interactions and point dimensions to serve semantic segmentation on point cloud data. We establish a large search space to jointly consider versatile point interactions and point dimensions. This supports point operators with various geometry/density considerations. The enlarged search space with heterogeneous search components calls for a better ranking of candidate models. To achieve this, we improve the search space exploration by leveraging predictor-based Neural Architecture Search (NAS), and enhance the quality of prediction by assigning unique encoding to heterogeneous search components based on their priors. We thoroughly evaluate the networks crafted by PIDS on two semantic segmentation benchmarks, showing ~1% mIOU improvement on SemanticKITTI and S3DIS over state-of-the-art 3D models.
title PIDS: Joint Point Interaction-Dimension Search for 3D Point Cloud
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2211.15759