JaywalkerVR: A VR System for Collecting Safety-Critical Pedestrian-Vehicle Interactions

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Mukoya, Kenta, Weng, Erica, Choudhury, Rohan, Kitani, Kris
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866929411317563392
author Mukoya, Kenta
Weng, Erica
Choudhury, Rohan
Kitani, Kris
author_facet Mukoya, Kenta
Weng, Erica
Choudhury, Rohan
Kitani, Kris
contents Developing autonomous vehicles that can safely interact with pedestrians requires large amounts of pedestrian and vehicle data in order to learn accurate pedestrian-vehicle interaction models. However, gathering data that include crucial but rare scenarios - such as pedestrians jaywalking into heavy traffic - can be costly and unsafe to collect. We propose a virtual reality human-in-the-loop simulator, JaywalkerVR, to obtain vehicle-pedestrian interaction data to address these challenges. Our system enables efficient, affordable, and safe collection of long-tail pedestrian-vehicle interaction data. Using our proposed simulator, we create a high-quality dataset with vehicle-pedestrian interaction data from safety critical scenarios called CARLA-VR. The CARLA-VR dataset addresses the lack of long-tail data samples in commonly used real world autonomous driving datasets. We demonstrate that models trained with CARLA-VR improve displacement error and collision rate by 10.7% and 4.9%, respectively, and are more robust in rare vehicle-pedestrian scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2407_04843
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle JaywalkerVR: A VR System for Collecting Safety-Critical Pedestrian-Vehicle Interactions
Mukoya, Kenta
Weng, Erica
Choudhury, Rohan
Kitani, Kris
Robotics
Developing autonomous vehicles that can safely interact with pedestrians requires large amounts of pedestrian and vehicle data in order to learn accurate pedestrian-vehicle interaction models. However, gathering data that include crucial but rare scenarios - such as pedestrians jaywalking into heavy traffic - can be costly and unsafe to collect. We propose a virtual reality human-in-the-loop simulator, JaywalkerVR, to obtain vehicle-pedestrian interaction data to address these challenges. Our system enables efficient, affordable, and safe collection of long-tail pedestrian-vehicle interaction data. Using our proposed simulator, we create a high-quality dataset with vehicle-pedestrian interaction data from safety critical scenarios called CARLA-VR. The CARLA-VR dataset addresses the lack of long-tail data samples in commonly used real world autonomous driving datasets. We demonstrate that models trained with CARLA-VR improve displacement error and collision rate by 10.7% and 4.9%, respectively, and are more robust in rare vehicle-pedestrian scenarios.
title JaywalkerVR: A VR System for Collecting Safety-Critical Pedestrian-Vehicle Interactions
topic Robotics
url https://arxiv.org/abs/2407.04843