Autonomous Vehicle Lateral Control Using Deep Reinforcement Learning with MPC-PID Demonstration
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866909636948393984 |
|---|---|
| author | Wu, Chengdong Kirchner, Sven Purschke, Nils Knoll, Alois C. |
| author_facet | Wu, Chengdong Kirchner, Sven Purschke, Nils Knoll, Alois C. |
| contents | The controller is one of the most important modules in the autonomous driving pipeline, ensuring the vehicle reaches its desired position. In this work, a reinforcement learning based lateral control approach, despite the imperfections in the vehicle models due to measurement errors and simplifications, is presented. Our approach ensures comfortable, efficient, and robust control performance considering the interface between controlling and other modules. The controller consists of the conventional Model Predictive Control (MPC)-PID part as the basis and the demonstrator, and the Deep Reinforcement Learning (DRL) part which leverages the online information from the MPC-PID part. The controller's performance is evaluated in CARLA using the ground truth of the waypoints as inputs. Experimental results demonstrate the effectiveness of the controller when vehicle information is incomplete, and the training of DRL can be stabilized with the demonstration part. These findings highlight the potential to reduce development and integration efforts for autonomous driving pipelines in the future. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_04040 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Autonomous Vehicle Lateral Control Using Deep Reinforcement Learning with MPC-PID Demonstration Wu, Chengdong Kirchner, Sven Purschke, Nils Knoll, Alois C. Robotics Machine Learning Systems and Control The controller is one of the most important modules in the autonomous driving pipeline, ensuring the vehicle reaches its desired position. In this work, a reinforcement learning based lateral control approach, despite the imperfections in the vehicle models due to measurement errors and simplifications, is presented. Our approach ensures comfortable, efficient, and robust control performance considering the interface between controlling and other modules. The controller consists of the conventional Model Predictive Control (MPC)-PID part as the basis and the demonstrator, and the Deep Reinforcement Learning (DRL) part which leverages the online information from the MPC-PID part. The controller's performance is evaluated in CARLA using the ground truth of the waypoints as inputs. Experimental results demonstrate the effectiveness of the controller when vehicle information is incomplete, and the training of DRL can be stabilized with the demonstration part. These findings highlight the potential to reduce development and integration efforts for autonomous driving pipelines in the future. |
| title | Autonomous Vehicle Lateral Control Using Deep Reinforcement Learning with MPC-PID Demonstration |
| topic | Robotics Machine Learning Systems and Control |
| url | https://arxiv.org/abs/2506.04040 |