Saved in:
Bibliographic Details
Main Authors: Yang, Ziyuan, Li, Zhaoyang, Hu, Jianming, Zhang, Yi
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2406.02865
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910474419830784
author Yang, Ziyuan
Li, Zhaoyang
Hu, Jianming
Zhang, Yi
author_facet Yang, Ziyuan
Li, Zhaoyang
Hu, Jianming
Zhang, Yi
contents The long-tail distribution of real driving data poses challenges for training and testing autonomous vehicles (AV), where rare yet crucial safety-critical scenarios are infrequent. And virtual simulation offers a low-cost and efficient solution. This paper proposes a near-miss focused training framework for AV. Utilizing the driving scenario information provided by sensors in the simulator, we design novel reward functions, which enable background vehicles (BV) to generate near-miss scenarios and ensure gradients exist not only in collision-free scenes but also in collision scenarios. And then leveraging the Robust Adversarial Reinforcement Learning (RARL) framework for simultaneous training of AV and BV to gradually enhance AV and BV capabilities, as well as generating near-miss scenarios tailored to different levels of AV capabilities. Results from three testing strategies indicate that the proposed method generates scenarios closer to near-miss, thus enhancing the capabilities of both AVs and BVs throughout training.
format Preprint
id arxiv_https___arxiv_org_abs_2406_02865
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Dynamically Expanding Capacity of Autonomous Driving with Near-Miss Focused Training Framework
Yang, Ziyuan
Li, Zhaoyang
Hu, Jianming
Zhang, Yi
Robotics
The long-tail distribution of real driving data poses challenges for training and testing autonomous vehicles (AV), where rare yet crucial safety-critical scenarios are infrequent. And virtual simulation offers a low-cost and efficient solution. This paper proposes a near-miss focused training framework for AV. Utilizing the driving scenario information provided by sensors in the simulator, we design novel reward functions, which enable background vehicles (BV) to generate near-miss scenarios and ensure gradients exist not only in collision-free scenes but also in collision scenarios. And then leveraging the Robust Adversarial Reinforcement Learning (RARL) framework for simultaneous training of AV and BV to gradually enhance AV and BV capabilities, as well as generating near-miss scenarios tailored to different levels of AV capabilities. Results from three testing strategies indicate that the proposed method generates scenarios closer to near-miss, thus enhancing the capabilities of both AVs and BVs throughout training.
title Dynamically Expanding Capacity of Autonomous Driving with Near-Miss Focused Training Framework
topic Robotics
url https://arxiv.org/abs/2406.02865