LiDAR-based 4D Occupancy Completion and Forecasting
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2023
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866910596741464064 |
|---|---|
| author | Liu, Xinhao Gong, Moonjun Fang, Qi Xie, Haoyu Li, Yiming Zhao, Hang Feng, Chen |
| author_facet | Liu, Xinhao Gong, Moonjun Fang, Qi Xie, Haoyu Li, Yiming Zhao, Hang Feng, Chen |
| contents | Scene completion and forecasting are two popular perception problems in research for mobile agents like autonomous vehicles. Existing approaches treat the two problems in isolation, resulting in a separate perception of the two aspects. In this paper, we introduce a novel LiDAR perception task of Occupancy Completion and Forecasting (OCF) in the context of autonomous driving to unify these aspects into a cohesive framework. This task requires new algorithms to address three challenges altogether: (1) sparse-to-dense reconstruction, (2) partial-to-complete hallucination, and (3) 3D-to-4D prediction. To enable supervision and evaluation, we curate a large-scale dataset termed OCFBench from public autonomous driving datasets. We analyze the performance of closely related existing baseline models and our own ones on our dataset. We envision that this research will inspire and call for further investigation in this evolving and crucial area of 4D perception. Our code for data curation and baseline implementation is available at https://github.com/ai4ce/Occ4cast. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2310_11239 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | LiDAR-based 4D Occupancy Completion and Forecasting Liu, Xinhao Gong, Moonjun Fang, Qi Xie, Haoyu Li, Yiming Zhao, Hang Feng, Chen Computer Vision and Pattern Recognition Robotics Scene completion and forecasting are two popular perception problems in research for mobile agents like autonomous vehicles. Existing approaches treat the two problems in isolation, resulting in a separate perception of the two aspects. In this paper, we introduce a novel LiDAR perception task of Occupancy Completion and Forecasting (OCF) in the context of autonomous driving to unify these aspects into a cohesive framework. This task requires new algorithms to address three challenges altogether: (1) sparse-to-dense reconstruction, (2) partial-to-complete hallucination, and (3) 3D-to-4D prediction. To enable supervision and evaluation, we curate a large-scale dataset termed OCFBench from public autonomous driving datasets. We analyze the performance of closely related existing baseline models and our own ones on our dataset. We envision that this research will inspire and call for further investigation in this evolving and crucial area of 4D perception. Our code for data curation and baseline implementation is available at https://github.com/ai4ce/Occ4cast. |
| title | LiDAR-based 4D Occupancy Completion and Forecasting |
| topic | Computer Vision and Pattern Recognition Robotics |
| url | https://arxiv.org/abs/2310.11239 |