TorchDriveEnv: A Reinforcement Learning Benchmark for Autonomous Driving with Reactive, Realistic, and Diverse Non-Playable Characters

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Lavington, Jonathan Wilder, Zhang, Ke, Lioutas, Vasileios, Niedoba, Matthew, Liu, Yunpeng, Green, Dylan, Naderiparizi, Saeid, Liang, Xiaoxuan, Dabiri, Setareh, Ścibior, Adam, Zwartsenberg, Berend, Wood, Frank
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916238194638848
author Lavington, Jonathan Wilder
Zhang, Ke
Lioutas, Vasileios
Niedoba, Matthew
Liu, Yunpeng
Green, Dylan
Naderiparizi, Saeid
Liang, Xiaoxuan
Dabiri, Setareh
Ścibior, Adam
Zwartsenberg, Berend
Wood, Frank
author_facet Lavington, Jonathan Wilder
Zhang, Ke
Lioutas, Vasileios
Niedoba, Matthew
Liu, Yunpeng
Green, Dylan
Naderiparizi, Saeid
Liang, Xiaoxuan
Dabiri, Setareh
Ścibior, Adam
Zwartsenberg, Berend
Wood, Frank
contents The training, testing, and deployment, of autonomous vehicles requires realistic and efficient simulators. Moreover, because of the high variability between different problems presented in different autonomous systems, these simulators need to be easy to use, and easy to modify. To address these problems we introduce TorchDriveSim and its benchmark extension TorchDriveEnv. TorchDriveEnv is a lightweight reinforcement learning benchmark programmed entirely in Python, which can be modified to test a number of different factors in learned vehicle behavior, including the effect of varying kinematic models, agent types, and traffic control patterns. Most importantly unlike many replay based simulation approaches, TorchDriveEnv is fully integrated with a state of the art behavioral simulation API. This allows users to train and evaluate driving models alongside data driven Non-Playable Characters (NPC) whose initializations and driving behavior are reactive, realistic, and diverse. We illustrate the efficiency and simplicity of TorchDriveEnv by evaluating common reinforcement learning baselines in both training and validation environments. Our experiments show that TorchDriveEnv is easy to use, but difficult to solve.
format Preprint
id arxiv_https___arxiv_org_abs_2405_04491
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle TorchDriveEnv: A Reinforcement Learning Benchmark for Autonomous Driving with Reactive, Realistic, and Diverse Non-Playable Characters
Lavington, Jonathan Wilder
Zhang, Ke
Lioutas, Vasileios
Niedoba, Matthew
Liu, Yunpeng
Green, Dylan
Naderiparizi, Saeid
Liang, Xiaoxuan
Dabiri, Setareh
Ścibior, Adam
Zwartsenberg, Berend
Wood, Frank
Artificial Intelligence
Machine Learning
Multiagent Systems
Robotics
The training, testing, and deployment, of autonomous vehicles requires realistic and efficient simulators. Moreover, because of the high variability between different problems presented in different autonomous systems, these simulators need to be easy to use, and easy to modify. To address these problems we introduce TorchDriveSim and its benchmark extension TorchDriveEnv. TorchDriveEnv is a lightweight reinforcement learning benchmark programmed entirely in Python, which can be modified to test a number of different factors in learned vehicle behavior, including the effect of varying kinematic models, agent types, and traffic control patterns. Most importantly unlike many replay based simulation approaches, TorchDriveEnv is fully integrated with a state of the art behavioral simulation API. This allows users to train and evaluate driving models alongside data driven Non-Playable Characters (NPC) whose initializations and driving behavior are reactive, realistic, and diverse. We illustrate the efficiency and simplicity of TorchDriveEnv by evaluating common reinforcement learning baselines in both training and validation environments. Our experiments show that TorchDriveEnv is easy to use, but difficult to solve.
title TorchDriveEnv: A Reinforcement Learning Benchmark for Autonomous Driving with Reactive, Realistic, and Diverse Non-Playable Characters
topic Artificial Intelligence
Machine Learning
Multiagent Systems
Robotics
url https://arxiv.org/abs/2405.04491