Autonomous overtaking trajectory optimization using reinforcement learning and opponent pose estimation

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Cihlar, Matej Rene, Šiktar, Luka, Ćaran, Branimir, Švaco, Marko
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866910081928396800
author Cihlar, Matej Rene
Šiktar, Luka
Ćaran, Branimir
Švaco, Marko
author_facet Cihlar, Matej Rene
Šiktar, Luka
Ćaran, Branimir
Švaco, Marko
contents Vehicle overtaking is one of the most complex driving maneuvers for autonomous vehicles. To achieve optimal autonomous overtaking, driving systems rely on multiple sensors that enable safe trajectory optimization and overtaking efficiency. This paper presents a reinforcement learning mechanism for multi-agent autonomous racing environments, enabling overtaking trajectory optimization, based on LiDAR and depth image data. The developed reinforcement learning agent uses pre-generated raceline data and sensor inputs to compute the steering angle and linear velocity for optimal overtaking. The system uses LiDAR with a 2D detection algorithm and a depth camera with YOLO-based object detection to identify the vehicle to be overtaken and its pose. The LiDAR and the depth camera detection data are fused using a UKF for improved opponent pose estimation and trajectory optimization for overtaking in racing scenarios. The results show that the proposed algorithm successfully performs overtaking maneuvers in both simulation and real-world experiments, with pose estimation RMSE of (0.0816, 0.0531) m in (x, y).
format Preprint
id arxiv_https___arxiv_org_abs_2603_27207
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Autonomous overtaking trajectory optimization using reinforcement learning and opponent pose estimation
Cihlar, Matej Rene
Šiktar, Luka
Ćaran, Branimir
Švaco, Marko
Robotics
Vehicle overtaking is one of the most complex driving maneuvers for autonomous vehicles. To achieve optimal autonomous overtaking, driving systems rely on multiple sensors that enable safe trajectory optimization and overtaking efficiency. This paper presents a reinforcement learning mechanism for multi-agent autonomous racing environments, enabling overtaking trajectory optimization, based on LiDAR and depth image data. The developed reinforcement learning agent uses pre-generated raceline data and sensor inputs to compute the steering angle and linear velocity for optimal overtaking. The system uses LiDAR with a 2D detection algorithm and a depth camera with YOLO-based object detection to identify the vehicle to be overtaken and its pose. The LiDAR and the depth camera detection data are fused using a UKF for improved opponent pose estimation and trajectory optimization for overtaking in racing scenarios. The results show that the proposed algorithm successfully performs overtaking maneuvers in both simulation and real-world experiments, with pose estimation RMSE of (0.0816, 0.0531) m in (x, y).
title Autonomous overtaking trajectory optimization using reinforcement learning and opponent pose estimation
topic Robotics
url https://arxiv.org/abs/2603.27207