Spatio-Temporal Graph Dual-Attention Network for Multi-Agent Prediction and Tracking

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Li, Jiachen, Ma, Hengbo, Zhang, Zhihao, Li, Jinning, Tomizuka, Masayoshi
Format: Preprint
Veröffentlicht: 2021
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866916454674202624
author Li, Jiachen
Ma, Hengbo
Zhang, Zhihao
Li, Jinning
Tomizuka, Masayoshi
author_facet Li, Jiachen
Ma, Hengbo
Zhang, Zhihao
Li, Jinning
Tomizuka, Masayoshi
contents An effective understanding of the environment and accurate trajectory prediction of surrounding dynamic obstacles are indispensable for intelligent mobile systems (e.g. autonomous vehicles and social robots) to achieve safe and high-quality planning when they navigate in highly interactive and crowded scenarios. Due to the existence of frequent interactions and uncertainty in the scene evolution, it is desired for the prediction system to enable relational reasoning on different entities and provide a distribution of future trajectories for each agent. In this paper, we propose a generic generative neural system (called STG-DAT) for multi-agent trajectory prediction involving heterogeneous agents. The system takes a step forward to explicit interaction modeling by incorporating relational inductive biases with a dynamic graph representation and leverages both trajectory and scene context information. We also employ an efficient kinematic constraint layer applied to vehicle trajectory prediction. The constraint not only ensures physical feasibility but also enhances model performance. Moreover, the proposed prediction model can be easily adopted by multi-target tracking frameworks. The tracking accuracy proves to be improved by empirical results. The proposed system is evaluated on three public benchmark datasets for trajectory prediction, where the agents cover pedestrians, cyclists and on-road vehicles. The experimental results demonstrate that our model achieves better performance than various baseline approaches in terms of prediction and tracking accuracy.
format Preprint
id arxiv_https___arxiv_org_abs_2102_09117
institution arXiv
publishDate 2021
record_format arxiv
spellingShingle Spatio-Temporal Graph Dual-Attention Network for Multi-Agent Prediction and Tracking
Li, Jiachen
Ma, Hengbo
Zhang, Zhihao
Li, Jinning
Tomizuka, Masayoshi
Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
Multiagent Systems
Robotics
An effective understanding of the environment and accurate trajectory prediction of surrounding dynamic obstacles are indispensable for intelligent mobile systems (e.g. autonomous vehicles and social robots) to achieve safe and high-quality planning when they navigate in highly interactive and crowded scenarios. Due to the existence of frequent interactions and uncertainty in the scene evolution, it is desired for the prediction system to enable relational reasoning on different entities and provide a distribution of future trajectories for each agent. In this paper, we propose a generic generative neural system (called STG-DAT) for multi-agent trajectory prediction involving heterogeneous agents. The system takes a step forward to explicit interaction modeling by incorporating relational inductive biases with a dynamic graph representation and leverages both trajectory and scene context information. We also employ an efficient kinematic constraint layer applied to vehicle trajectory prediction. The constraint not only ensures physical feasibility but also enhances model performance. Moreover, the proposed prediction model can be easily adopted by multi-target tracking frameworks. The tracking accuracy proves to be improved by empirical results. The proposed system is evaluated on three public benchmark datasets for trajectory prediction, where the agents cover pedestrians, cyclists and on-road vehicles. The experimental results demonstrate that our model achieves better performance than various baseline approaches in terms of prediction and tracking accuracy.
title Spatio-Temporal Graph Dual-Attention Network for Multi-Agent Prediction and Tracking
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
Multiagent Systems
Robotics
url https://arxiv.org/abs/2102.09117