PointVDP: Learning View-Dependent Projection by Fireworks Rays for 3D Point Cloud Segmentation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Chen, Yang, Duan, Yueqi, Sun, Haowen, Wang, Ziwei, Lu, Jiwen, Tan, Yap-Peng
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911275697569792
author Chen, Yang
Duan, Yueqi
Sun, Haowen
Wang, Ziwei
Lu, Jiwen
Tan, Yap-Peng
author_facet Chen, Yang
Duan, Yueqi
Sun, Haowen
Wang, Ziwei
Lu, Jiwen
Tan, Yap-Peng
contents In this paper, we propose view-dependent projection (VDP) to facilitate point cloud segmentation, designing efficient 3D-to-2D mapping that dynamically adapts to the spatial geometry from view variations. Existing projection-based methods leverage view-independent projection in complex scenes, relying on straight lines to generate direct rays or upward curves to reduce occlusions. However, their view independence provides projection rays that are limited to pre-defined parameters by human settings, restricting point awareness and failing to capture sufficient projection diversity across different view planes. Although multiple projections per view plane are commonly used to enhance spatial variety, the projected redundancy leads to excessive computational overhead and inefficiency in image processing. To address these limitations, we design a framework of VDP to generate data-driven projections from 3D point distributions, producing highly informative single-image inputs by predicting rays inspired by the adaptive behavior of fireworks. In addition, we construct color regularization to optimize the framework, which emphasizes essential features within semantic pixels and suppresses the non-semantic features within black pixels, thereby maximizing 2D space utilization in a projected image. As a result, our approach, PointVDP, develops lightweight projections in marginal computation costs. Experiments on S3DIS and ScanNet benchmarks show that our approach achieves competitive results, offering a resource-efficient solution for semantic understanding.
format Preprint
id arxiv_https___arxiv_org_abs_2507_06618
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle PointVDP: Learning View-Dependent Projection by Fireworks Rays for 3D Point Cloud Segmentation
Chen, Yang
Duan, Yueqi
Sun, Haowen
Wang, Ziwei
Lu, Jiwen
Tan, Yap-Peng
Computer Vision and Pattern Recognition
In this paper, we propose view-dependent projection (VDP) to facilitate point cloud segmentation, designing efficient 3D-to-2D mapping that dynamically adapts to the spatial geometry from view variations. Existing projection-based methods leverage view-independent projection in complex scenes, relying on straight lines to generate direct rays or upward curves to reduce occlusions. However, their view independence provides projection rays that are limited to pre-defined parameters by human settings, restricting point awareness and failing to capture sufficient projection diversity across different view planes. Although multiple projections per view plane are commonly used to enhance spatial variety, the projected redundancy leads to excessive computational overhead and inefficiency in image processing. To address these limitations, we design a framework of VDP to generate data-driven projections from 3D point distributions, producing highly informative single-image inputs by predicting rays inspired by the adaptive behavior of fireworks. In addition, we construct color regularization to optimize the framework, which emphasizes essential features within semantic pixels and suppresses the non-semantic features within black pixels, thereby maximizing 2D space utilization in a projected image. As a result, our approach, PointVDP, develops lightweight projections in marginal computation costs. Experiments on S3DIS and ScanNet benchmarks show that our approach achieves competitive results, offering a resource-efficient solution for semantic understanding.
title PointVDP: Learning View-Dependent Projection by Fireworks Rays for 3D Point Cloud Segmentation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2507.06618