LOPR: Latent Occupancy PRediction using Generative Models

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Lange, Bernard, Itkina, Masha, Kochenderfer, Mykel J.
Formato: Preprint
Publicado: 2022
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866911215435907072
author Lange, Bernard
Itkina, Masha
Kochenderfer, Mykel J.
author_facet Lange, Bernard
Itkina, Masha
Kochenderfer, Mykel J.
contents Environment prediction frameworks are integral for autonomous vehicles, enabling safe navigation in dynamic environments. LiDAR generated occupancy grid maps (L-OGMs) offer a robust bird's eye-view scene representation that facilitates joint scene predictions without relying on manual labeling unlike commonly used trajectory prediction frameworks. Prior approaches have optimized deterministic L-OGM prediction architectures directly in grid cell space. While these methods have achieved some degree of success in prediction, they occasionally grapple with unrealistic and incorrect predictions. We claim that the quality and realism of the forecasted occupancy grids can be enhanced with the use of generative models. We propose a framework that decouples occupancy prediction into: representation learning and stochastic prediction within the learned latent space. Our approach allows for conditioning the model on other available sensor modalities such as RGB-cameras and high definition maps. We demonstrate that our approach achieves state-of-the-art performance and is readily transferable between different robotic platforms on the real-world NuScenes, Waymo Open, and a custom dataset we collected on an experimental vehicle platform.
format Preprint
id arxiv_https___arxiv_org_abs_2210_01249
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle LOPR: Latent Occupancy PRediction using Generative Models
Lange, Bernard
Itkina, Masha
Kochenderfer, Mykel J.
Robotics
Computer Vision and Pattern Recognition
Environment prediction frameworks are integral for autonomous vehicles, enabling safe navigation in dynamic environments. LiDAR generated occupancy grid maps (L-OGMs) offer a robust bird's eye-view scene representation that facilitates joint scene predictions without relying on manual labeling unlike commonly used trajectory prediction frameworks. Prior approaches have optimized deterministic L-OGM prediction architectures directly in grid cell space. While these methods have achieved some degree of success in prediction, they occasionally grapple with unrealistic and incorrect predictions. We claim that the quality and realism of the forecasted occupancy grids can be enhanced with the use of generative models. We propose a framework that decouples occupancy prediction into: representation learning and stochastic prediction within the learned latent space. Our approach allows for conditioning the model on other available sensor modalities such as RGB-cameras and high definition maps. We demonstrate that our approach achieves state-of-the-art performance and is readily transferable between different robotic platforms on the real-world NuScenes, Waymo Open, and a custom dataset we collected on an experimental vehicle platform.
title LOPR: Latent Occupancy PRediction using Generative Models
topic Robotics
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2210.01249