Complementary Information Guided Occupancy Prediction via Multi-Level Representation Fusion
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909847350411264 |
|---|---|
| author | Xu, Rongtao Lin, Jinzhou Zhou, Jialei Dong, Jiahua Wang, Changwei Wang, Ruisheng Guo, Li Xu, Shibiao Liang, Xiaodan |
| author_facet | Xu, Rongtao Lin, Jinzhou Zhou, Jialei Dong, Jiahua Wang, Changwei Wang, Ruisheng Guo, Li Xu, Shibiao Liang, Xiaodan |
| contents | Camera-based occupancy prediction is a mainstream approach for 3D perception in autonomous driving, aiming to infer complete 3D scene geometry and semantics from 2D images. Almost existing methods focus on improving performance through structural modifications, such as lightweight backbones and complex cascaded frameworks, with good yet limited performance. Few studies explore from the perspective of representation fusion, leaving the rich diversity of features in 2D images underutilized. Motivated by this, we propose \textbf{CIGOcc, a two-stage occupancy prediction framework based on multi-level representation fusion. \textbf{CIGOcc extracts segmentation, graphics, and depth features from an input image and introduces a deformable multi-level fusion mechanism to fuse these three multi-level features. Additionally, CIGOcc incorporates knowledge distilled from SAM to further enhance prediction accuracy. Without increasing training costs, CIGOcc achieves state-of-the-art performance on the SemanticKITTI benchmark. The code is provided in the supplementary material and will be released https://github.com/VitaLemonTea1/CIGOcc |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_13198 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Complementary Information Guided Occupancy Prediction via Multi-Level Representation Fusion Xu, Rongtao Lin, Jinzhou Zhou, Jialei Dong, Jiahua Wang, Changwei Wang, Ruisheng Guo, Li Xu, Shibiao Liang, Xiaodan Computer Vision and Pattern Recognition Camera-based occupancy prediction is a mainstream approach for 3D perception in autonomous driving, aiming to infer complete 3D scene geometry and semantics from 2D images. Almost existing methods focus on improving performance through structural modifications, such as lightweight backbones and complex cascaded frameworks, with good yet limited performance. Few studies explore from the perspective of representation fusion, leaving the rich diversity of features in 2D images underutilized. Motivated by this, we propose \textbf{CIGOcc, a two-stage occupancy prediction framework based on multi-level representation fusion. \textbf{CIGOcc extracts segmentation, graphics, and depth features from an input image and introduces a deformable multi-level fusion mechanism to fuse these three multi-level features. Additionally, CIGOcc incorporates knowledge distilled from SAM to further enhance prediction accuracy. Without increasing training costs, CIGOcc achieves state-of-the-art performance on the SemanticKITTI benchmark. The code is provided in the supplementary material and will be released https://github.com/VitaLemonTea1/CIGOcc |
| title | Complementary Information Guided Occupancy Prediction via Multi-Level Representation Fusion |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2510.13198 |