Saved in:
Bibliographic Details
Main Authors: Riaz, Muhammad Naveed, Wielgosz, Maciej, Romera, Abel Garcia, Lopez, Antonio M.
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2401.06757
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910488242159616
author Riaz, Muhammad Naveed
Wielgosz, Maciej
Romera, Abel Garcia
Lopez, Antonio M.
author_facet Riaz, Muhammad Naveed
Wielgosz, Maciej
Romera, Abel Garcia
Lopez, Antonio M.
contents Pedestrian intention prediction is crucial for autonomous driving. In particular, knowing if pedestrians are going to cross in front of the ego-vehicle is core to performing safe and comfortable maneuvers. Creating accurate and fast models that predict such intentions from sequential images is challenging. A factor contributing to this is the lack of datasets with diverse crossing and non-crossing (C/NC) scenarios. We address this scarceness by introducing a framework, named ARCANE, which allows programmatically generating synthetic datasets consisting of C/NC video clip samples. As an example, we use ARCANE to generate a large and diverse dataset named PedSynth. We will show how PedSynth complements widely used real-world datasets such as JAAD and PIE, so enabling more accurate models for C/NC prediction. Considering the onboard deployment of C/NC prediction models, we also propose a deep model named PedGNN, which is fast and has a very low memory footprint. PedGNN is based on a GNN-GRU architecture that takes a sequence of pedestrian skeletons as input to predict crossing intentions.
format Preprint
id arxiv_https___arxiv_org_abs_2401_06757
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Synthetic Data Generation Framework, Dataset, and Efficient Deep Model for Pedestrian Intention Prediction
Riaz, Muhammad Naveed
Wielgosz, Maciej
Romera, Abel Garcia
Lopez, Antonio M.
Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
Pedestrian intention prediction is crucial for autonomous driving. In particular, knowing if pedestrians are going to cross in front of the ego-vehicle is core to performing safe and comfortable maneuvers. Creating accurate and fast models that predict such intentions from sequential images is challenging. A factor contributing to this is the lack of datasets with diverse crossing and non-crossing (C/NC) scenarios. We address this scarceness by introducing a framework, named ARCANE, which allows programmatically generating synthetic datasets consisting of C/NC video clip samples. As an example, we use ARCANE to generate a large and diverse dataset named PedSynth. We will show how PedSynth complements widely used real-world datasets such as JAAD and PIE, so enabling more accurate models for C/NC prediction. Considering the onboard deployment of C/NC prediction models, we also propose a deep model named PedGNN, which is fast and has a very low memory footprint. PedGNN is based on a GNN-GRU architecture that takes a sequence of pedestrian skeletons as input to predict crossing intentions.
title Synthetic Data Generation Framework, Dataset, and Efficient Deep Model for Pedestrian Intention Prediction
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2401.06757