Integrating Specialized and Generic Agent Motion Prediction with Dynamic Occupancy Grid Maps

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Asghar, Rabbia, Rummelhard, Lukas, Liu, Wenqian, Spalanzani, Anne, Laugier, Christian
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866918327519019008
author Asghar, Rabbia
Rummelhard, Lukas
Liu, Wenqian
Spalanzani, Anne
Laugier, Christian
author_facet Asghar, Rabbia
Rummelhard, Lukas
Liu, Wenqian
Spalanzani, Anne
Laugier, Christian
contents Accurate prediction of driving scene is a challenging task due to uncertainty in sensor data, the complex behaviors of agents, and the possibility of multiple feasible futures. Existing prediction methods using occupancy grid maps primarily focus on agent-agnostic scene predictions, while agent-specific predictions provide specialized behavior insights with the help of semantic information. However, both paradigms face distinct limitations: agent-agnostic models struggle to capture the behavioral complexities of dynamic actors, whereas agent-specific approaches fail to generalize to poorly perceived or unrecognized agents; combining both enables robust and safer motion forecasting. To address this, we propose a unified framework by leveraging Dynamic Occupancy Grid Maps within a streamlined temporal decoding pipeline to simultaneously predict future occupancy state grids, vehicle grids, and scene flow grids. Relying on a lightweight spatiotemporal backbone, our approach is centered on a tailored, interdependent loss function that captures inter-grid dependencies and enables diverse future predictions. By using occupancy state information to enforce flow-guided transitions, the loss function acts as a regularizer that directs occupancy evolution while accounting for obstacles and occlusions. Consequently, the model not only predicts the specific behaviors of vehicle agents, but also identifies other dynamic entities and anticipates their evolution within the complex scene. Evaluations on real-world nuScenes and Woven Planet datasets demonstrate superior prediction performances for dynamic vehicles and generic dynamic scene elements compared to baseline methods.
format Preprint
id arxiv_https___arxiv_org_abs_2602_07938
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Integrating Specialized and Generic Agent Motion Prediction with Dynamic Occupancy Grid Maps
Asghar, Rabbia
Rummelhard, Lukas
Liu, Wenqian
Spalanzani, Anne
Laugier, Christian
Computer Vision and Pattern Recognition
Robotics
Accurate prediction of driving scene is a challenging task due to uncertainty in sensor data, the complex behaviors of agents, and the possibility of multiple feasible futures. Existing prediction methods using occupancy grid maps primarily focus on agent-agnostic scene predictions, while agent-specific predictions provide specialized behavior insights with the help of semantic information. However, both paradigms face distinct limitations: agent-agnostic models struggle to capture the behavioral complexities of dynamic actors, whereas agent-specific approaches fail to generalize to poorly perceived or unrecognized agents; combining both enables robust and safer motion forecasting. To address this, we propose a unified framework by leveraging Dynamic Occupancy Grid Maps within a streamlined temporal decoding pipeline to simultaneously predict future occupancy state grids, vehicle grids, and scene flow grids. Relying on a lightweight spatiotemporal backbone, our approach is centered on a tailored, interdependent loss function that captures inter-grid dependencies and enables diverse future predictions. By using occupancy state information to enforce flow-guided transitions, the loss function acts as a regularizer that directs occupancy evolution while accounting for obstacles and occlusions. Consequently, the model not only predicts the specific behaviors of vehicle agents, but also identifies other dynamic entities and anticipates their evolution within the complex scene. Evaluations on real-world nuScenes and Woven Planet datasets demonstrate superior prediction performances for dynamic vehicles and generic dynamic scene elements compared to baseline methods.
title Integrating Specialized and Generic Agent Motion Prediction with Dynamic Occupancy Grid Maps
topic Computer Vision and Pattern Recognition
Robotics
url https://arxiv.org/abs/2602.07938