Out-of-Distribution Semantic Occupancy Prediction

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Zhang, Yuheng, Duan, Mengfei, Peng, Kunyu, Wang, Yuhang, Liu, Ruiping, Teng, Fei, Luo, Kai, Li, Zhiyong, Yang, Kailun
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866911365049876480
author Zhang, Yuheng
Duan, Mengfei
Peng, Kunyu
Wang, Yuhang
Liu, Ruiping
Teng, Fei
Luo, Kai
Li, Zhiyong
Yang, Kailun
author_facet Zhang, Yuheng
Duan, Mengfei
Peng, Kunyu
Wang, Yuhang
Liu, Ruiping
Teng, Fei
Luo, Kai
Li, Zhiyong
Yang, Kailun
contents 3D semantic occupancy prediction is crucial for autonomous driving, providing a dense, semantically rich environmental representation. However, existing methods focus on in-distribution scenes, making them susceptible to Out-of-Distribution (OoD) objects and long-tail distributions, which increases the risk of undetected anomalies and misinterpretations, posing safety hazards. To address these challenges, we introduce Out-of-Distribution Semantic Occupancy Prediction, targeting OoD detection in 3D voxel space. To fill dataset gaps, we propose a Realistic Anomaly Augmentation that injects synthetic anomalies while preserving realistic spatial and occlusion patterns, enabling the creation of two datasets: VAA-KITTI and VAA-KITTI-360. Then, a novel framework that integrates OoD detection into 3D semantic occupancy prediction, OccOoD, is proposed, which uses Cross-Space Semantic Refinement (CSSR) to refine semantic predictions from complementary voxel and BEV representations, improving OoD detection. Experimental results demonstrate that OccOoD achieves state-of-the-art OoD detection with an AuROC of 65.50% and an AuPRCr of 31.83 within a 1.2m region, while maintaining competitive semantic occupancy prediction performance and generalization in real-world urban driving scenes. The established datasets and source code will be made publicly available at https://github.com/7uHeng/OccOoD.
format Preprint
id arxiv_https___arxiv_org_abs_2506_21185
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Out-of-Distribution Semantic Occupancy Prediction
Zhang, Yuheng
Duan, Mengfei
Peng, Kunyu
Wang, Yuhang
Liu, Ruiping
Teng, Fei
Luo, Kai
Li, Zhiyong
Yang, Kailun
Computer Vision and Pattern Recognition
Robotics
Image and Video Processing
3D semantic occupancy prediction is crucial for autonomous driving, providing a dense, semantically rich environmental representation. However, existing methods focus on in-distribution scenes, making them susceptible to Out-of-Distribution (OoD) objects and long-tail distributions, which increases the risk of undetected anomalies and misinterpretations, posing safety hazards. To address these challenges, we introduce Out-of-Distribution Semantic Occupancy Prediction, targeting OoD detection in 3D voxel space. To fill dataset gaps, we propose a Realistic Anomaly Augmentation that injects synthetic anomalies while preserving realistic spatial and occlusion patterns, enabling the creation of two datasets: VAA-KITTI and VAA-KITTI-360. Then, a novel framework that integrates OoD detection into 3D semantic occupancy prediction, OccOoD, is proposed, which uses Cross-Space Semantic Refinement (CSSR) to refine semantic predictions from complementary voxel and BEV representations, improving OoD detection. Experimental results demonstrate that OccOoD achieves state-of-the-art OoD detection with an AuROC of 65.50% and an AuPRCr of 31.83 within a 1.2m region, while maintaining competitive semantic occupancy prediction performance and generalization in real-world urban driving scenes. The established datasets and source code will be made publicly available at https://github.com/7uHeng/OccOoD.
title Out-of-Distribution Semantic Occupancy Prediction
topic Computer Vision and Pattern Recognition
Robotics
Image and Video Processing
url https://arxiv.org/abs/2506.21185