SliceSemOcc: Vertical Slice Based Multimodal 3D Semantic Occupancy Representation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Huang, Han, Sun, Han, Liu, Ningzhong, Zhou, Huiyu, Shen, Jiaquan
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914022050234368
author Huang, Han
Sun, Han
Liu, Ningzhong
Zhou, Huiyu
Shen, Jiaquan
author_facet Huang, Han
Sun, Han
Liu, Ningzhong
Zhou, Huiyu
Shen, Jiaquan
contents Driven by autonomous driving's demands for precise 3D perception, 3D semantic occupancy prediction has become a pivotal research topic. Unlike bird's-eye-view (BEV) methods, which restrict scene representation to a 2D plane, occupancy prediction leverages a complete 3D voxel grid to model spatial structures in all dimensions, thereby capturing semantic variations along the vertical axis. However, most existing approaches overlook height-axis information when processing voxel features. And conventional SENet-style channel attention assigns uniform weight across all height layers, limiting their ability to emphasize features at different heights. To address these limitations, we propose SliceSemOcc, a novel vertical slice based multimodal framework for 3D semantic occupancy representation. Specifically, we extract voxel features along the height-axis using both global and local vertical slices. Then, a global local fusion module adaptively reconciles fine-grained spatial details with holistic contextual information. Furthermore, we propose the SEAttention3D module, which preserves height-wise resolution through average pooling and assigns dynamic channel attention weights to each height layer. Extensive experiments on nuScenes-SurroundOcc and nuScenes-OpenOccupancy datasets verify that our method significantly enhances mean IoU, achieving especially pronounced gains on most small-object categories. Detailed ablation studies further validate the effectiveness of the proposed SliceSemOcc framework.
format Preprint
id arxiv_https___arxiv_org_abs_2509_03999
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle SliceSemOcc: Vertical Slice Based Multimodal 3D Semantic Occupancy Representation
Huang, Han
Sun, Han
Liu, Ningzhong
Zhou, Huiyu
Shen, Jiaquan
Computer Vision and Pattern Recognition
Driven by autonomous driving's demands for precise 3D perception, 3D semantic occupancy prediction has become a pivotal research topic. Unlike bird's-eye-view (BEV) methods, which restrict scene representation to a 2D plane, occupancy prediction leverages a complete 3D voxel grid to model spatial structures in all dimensions, thereby capturing semantic variations along the vertical axis. However, most existing approaches overlook height-axis information when processing voxel features. And conventional SENet-style channel attention assigns uniform weight across all height layers, limiting their ability to emphasize features at different heights. To address these limitations, we propose SliceSemOcc, a novel vertical slice based multimodal framework for 3D semantic occupancy representation. Specifically, we extract voxel features along the height-axis using both global and local vertical slices. Then, a global local fusion module adaptively reconciles fine-grained spatial details with holistic contextual information. Furthermore, we propose the SEAttention3D module, which preserves height-wise resolution through average pooling and assigns dynamic channel attention weights to each height layer. Extensive experiments on nuScenes-SurroundOcc and nuScenes-OpenOccupancy datasets verify that our method significantly enhances mean IoU, achieving especially pronounced gains on most small-object categories. Detailed ablation studies further validate the effectiveness of the proposed SliceSemOcc framework.
title SliceSemOcc: Vertical Slice Based Multimodal 3D Semantic Occupancy Representation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2509.03999