Point Cloud Semantic Segmentation with Sparse and Inhomogeneous Annotations

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Pan, Zhiyi, Zhang, Nan, Gao, Wei, Liu, Shan, Li, Ge
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915070360944640
author Pan, Zhiyi
Zhang, Nan
Gao, Wei
Liu, Shan
Li, Ge
author_facet Pan, Zhiyi
Zhang, Nan
Gao, Wei
Liu, Shan
Li, Ge
contents Utilizing uniformly distributed sparse annotations, weakly supervised learning alleviates the heavy reliance on fine-grained annotations in point cloud semantic segmentation tasks. However, few works discuss the inhomogeneity of sparse annotations, albeit it is common in real-world scenarios. Therefore, this work introduces the probability density function into the gradient sampling approximation method to qualitatively analyze the impact of annotation sparsity and inhomogeneity under weakly supervised learning. Based on our analysis, we propose an Adaptive Annotation Distribution Network (AADNet) capable of robust learning on arbitrarily distributed sparse annotations. Specifically, we propose a label-aware point cloud downsampling strategy to increase the proportion of annotations involved in the training stage. Furthermore, we design the multiplicative dynamic entropy as the gradient calibration function to mitigate the gradient bias caused by non-uniformly distributed sparse annotations and explicitly reduce the epistemic uncertainty. Without any prior restrictions and additional information, our proposed method achieves comprehensive performance improvements at multiple label rates and different annotation distributions.
format Preprint
id arxiv_https___arxiv_org_abs_2312_06259
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Point Cloud Semantic Segmentation with Sparse and Inhomogeneous Annotations
Pan, Zhiyi
Zhang, Nan
Gao, Wei
Liu, Shan
Li, Ge
Computer Vision and Pattern Recognition
Utilizing uniformly distributed sparse annotations, weakly supervised learning alleviates the heavy reliance on fine-grained annotations in point cloud semantic segmentation tasks. However, few works discuss the inhomogeneity of sparse annotations, albeit it is common in real-world scenarios. Therefore, this work introduces the probability density function into the gradient sampling approximation method to qualitatively analyze the impact of annotation sparsity and inhomogeneity under weakly supervised learning. Based on our analysis, we propose an Adaptive Annotation Distribution Network (AADNet) capable of robust learning on arbitrarily distributed sparse annotations. Specifically, we propose a label-aware point cloud downsampling strategy to increase the proportion of annotations involved in the training stage. Furthermore, we design the multiplicative dynamic entropy as the gradient calibration function to mitigate the gradient bias caused by non-uniformly distributed sparse annotations and explicitly reduce the epistemic uncertainty. Without any prior restrictions and additional information, our proposed method achieves comprehensive performance improvements at multiple label rates and different annotation distributions.
title Point Cloud Semantic Segmentation with Sparse and Inhomogeneous Annotations
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2312.06259