PVP: Polar Representation Boost for 3D Semantic Occupancy Prediction

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Xue, Yujing, Liu, Jiaxiang, Du, Jiawei, Zhou, Joey Tianyi
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913616953868288
author Xue, Yujing
Liu, Jiaxiang
Du, Jiawei
Zhou, Joey Tianyi
author_facet Xue, Yujing
Liu, Jiaxiang
Du, Jiawei
Zhou, Joey Tianyi
contents Recently, polar coordinate-based representations have shown promise for 3D perceptual tasks. Compared to Cartesian methods, polar grids provide a viable alternative, offering better detail preservation in nearby spaces while covering larger areas. However, they face feature distortion due to non-uniform division. To address these issues, we introduce the Polar Voxel Occupancy Predictor (PVP), a novel 3D multi-modal predictor that operates in polar coordinates. PVP features two key design elements to overcome distortion: a Global Represent Propagation (GRP) module that integrates global spatial data into 3D volumes, and a Plane Decomposed Convolution (PD-Conv) that simplifies 3D distortions into 2D convolutions. These innovations enable PVP to outperform existing methods, achieving significant improvements in mIoU and IoU metrics on the OpenOccupancy dataset.
format Preprint
id arxiv_https___arxiv_org_abs_2412_07616
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle PVP: Polar Representation Boost for 3D Semantic Occupancy Prediction
Xue, Yujing
Liu, Jiaxiang
Du, Jiawei
Zhou, Joey Tianyi
Computer Vision and Pattern Recognition
Recently, polar coordinate-based representations have shown promise for 3D perceptual tasks. Compared to Cartesian methods, polar grids provide a viable alternative, offering better detail preservation in nearby spaces while covering larger areas. However, they face feature distortion due to non-uniform division. To address these issues, we introduce the Polar Voxel Occupancy Predictor (PVP), a novel 3D multi-modal predictor that operates in polar coordinates. PVP features two key design elements to overcome distortion: a Global Represent Propagation (GRP) module that integrates global spatial data into 3D volumes, and a Plane Decomposed Convolution (PD-Conv) that simplifies 3D distortions into 2D convolutions. These innovations enable PVP to outperform existing methods, achieving significant improvements in mIoU and IoU metrics on the OpenOccupancy dataset.
title PVP: Polar Representation Boost for 3D Semantic Occupancy Prediction
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2412.07616