Predictive Traffic Rule Compliance using Reinforcement Learning

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Huang, Yanliang, Mair, Sebastian, Zeng, Zhuoqi, Althoff, Matthias
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912308949680128
author Huang, Yanliang
Mair, Sebastian
Zeng, Zhuoqi
Althoff, Matthias
author_facet Huang, Yanliang
Mair, Sebastian
Zeng, Zhuoqi
Althoff, Matthias
contents Autonomous vehicle path planning has reached a stage where safety and regulatory compliance are crucial. This paper presents an approach that integrates a motion planner with a deep reinforcement learning model to predict potential traffic rule violations. Our main innovation is replacing the standard actor network in an actor-critic method with a motion planning module, which ensures both stable and interpretable trajectory generation. In this setup, we use traffic rule robustness as the reward to train a reinforcement learning agent's critic, and the output of the critic is directly used as the cost function of the motion planner, which guides the choices of the trajectory. We incorporate some key interstate rules from the German Road Traffic Regulation into a rule book and use a graph-based state representation to handle complex traffic information. Experiments on an open German highway dataset show that the model can predict and prevent traffic rule violations beyond the planning horizon, increasing safety and rule compliance in challenging traffic scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2503_22925
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Predictive Traffic Rule Compliance using Reinforcement Learning
Huang, Yanliang
Mair, Sebastian
Zeng, Zhuoqi
Althoff, Matthias
Robotics
Artificial Intelligence
I.2.9; I.2.6
Autonomous vehicle path planning has reached a stage where safety and regulatory compliance are crucial. This paper presents an approach that integrates a motion planner with a deep reinforcement learning model to predict potential traffic rule violations. Our main innovation is replacing the standard actor network in an actor-critic method with a motion planning module, which ensures both stable and interpretable trajectory generation. In this setup, we use traffic rule robustness as the reward to train a reinforcement learning agent's critic, and the output of the critic is directly used as the cost function of the motion planner, which guides the choices of the trajectory. We incorporate some key interstate rules from the German Road Traffic Regulation into a rule book and use a graph-based state representation to handle complex traffic information. Experiments on an open German highway dataset show that the model can predict and prevent traffic rule violations beyond the planning horizon, increasing safety and rule compliance in challenging traffic scenarios.
title Predictive Traffic Rule Compliance using Reinforcement Learning
topic Robotics
Artificial Intelligence
I.2.9; I.2.6
url https://arxiv.org/abs/2503.22925