HAD-Gen: Human-like and Diverse Driving Behavior Modeling for Controllable Scenario Generation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wang, Cheng, Kong, Lingxin, Tamborski, Massimiliano, Albrecht, Stefano V.
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909883707686912
author Wang, Cheng
Kong, Lingxin
Tamborski, Massimiliano
Albrecht, Stefano V.
author_facet Wang, Cheng
Kong, Lingxin
Tamborski, Massimiliano
Albrecht, Stefano V.
contents Simulation-based testing has emerged as an essential tool for verifying and validating autonomous vehicles (AVs). However, contemporary methodologies, such as deterministic and imitation learning-based driver models, struggle to capture the variability of human-like driving behavior. Given these challenges, we propose HAD-Gen, a general framework for realistic traffic scenario generation that simulates diverse human-like driving behaviors. The framework first clusters the vehicle trajectory data into different driving styles according to safety features. It then employs maximum entropy inverse reinforcement learning on each of the clusters to learn the reward function corresponding to each driving style. Using these reward functions, the method integrates offline reinforcement learning pre-training and multi-agent reinforcement learning algorithms to obtain general and robust driving policies. Multi-perspective simulation results show that our proposed scenario generation framework can simulate diverse, human-like driving behaviors with strong generalization capability. The proposed framework achieves a 90.96% goal-reaching rate, an off-road rate of 2.08%, and a collision rate of 6.91% in the generalization test, outperforming prior approaches by over 20% in goal-reaching performance. The source code is released at https://github.com/RoboSafe-Lab/Sim4AD.
format Preprint
id arxiv_https___arxiv_org_abs_2503_15049
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle HAD-Gen: Human-like and Diverse Driving Behavior Modeling for Controllable Scenario Generation
Wang, Cheng
Kong, Lingxin
Tamborski, Massimiliano
Albrecht, Stefano V.
Robotics
Artificial Intelligence
Multiagent Systems
Simulation-based testing has emerged as an essential tool for verifying and validating autonomous vehicles (AVs). However, contemporary methodologies, such as deterministic and imitation learning-based driver models, struggle to capture the variability of human-like driving behavior. Given these challenges, we propose HAD-Gen, a general framework for realistic traffic scenario generation that simulates diverse human-like driving behaviors. The framework first clusters the vehicle trajectory data into different driving styles according to safety features. It then employs maximum entropy inverse reinforcement learning on each of the clusters to learn the reward function corresponding to each driving style. Using these reward functions, the method integrates offline reinforcement learning pre-training and multi-agent reinforcement learning algorithms to obtain general and robust driving policies. Multi-perspective simulation results show that our proposed scenario generation framework can simulate diverse, human-like driving behaviors with strong generalization capability. The proposed framework achieves a 90.96% goal-reaching rate, an off-road rate of 2.08%, and a collision rate of 6.91% in the generalization test, outperforming prior approaches by over 20% in goal-reaching performance. The source code is released at https://github.com/RoboSafe-Lab/Sim4AD.
title HAD-Gen: Human-like and Diverse Driving Behavior Modeling for Controllable Scenario Generation
topic Robotics
Artificial Intelligence
Multiagent Systems
url https://arxiv.org/abs/2503.15049