Partial End-to-end Reinforcement Learning for Robustness Against Modelling Error in Autonomous Racing
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , |
|---|---|
| Format: | Preprint |
| Publié: |
2023
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866916345367494656 |
|---|---|
| author | Murdoch, Andrew Schoeman, Johannes Cornelius Jordaan, Hendrik Willem |
| author_facet | Murdoch, Andrew Schoeman, Johannes Cornelius Jordaan, Hendrik Willem |
| contents | In this paper, we address the issue of increasing the performance of reinforcement learning (RL) solutions for autonomous racing cars when navigating under conditions where practical vehicle modelling errors (commonly known as \emph{model mismatches}) are present. To address this challenge, we propose a partial end-to-end algorithm that decouples the planning and control tasks. Within this framework, an RL agent generates a trajectory comprising a path and velocity, which is subsequently tracked using a pure pursuit steering controller and a proportional velocity controller, respectively. In contrast, many current learning-based (i.e., reinforcement and imitation learning) algorithms utilise an end-to-end approach whereby a deep neural network directly maps from sensor data to control commands. By leveraging the robustness of a classical controller, our partial end-to-end driving algorithm exhibits better robustness towards model mismatches than standard end-to-end algorithms. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2312_06406 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Partial End-to-end Reinforcement Learning for Robustness Against Modelling Error in Autonomous Racing Murdoch, Andrew Schoeman, Johannes Cornelius Jordaan, Hendrik Willem Robotics Artificial Intelligence In this paper, we address the issue of increasing the performance of reinforcement learning (RL) solutions for autonomous racing cars when navigating under conditions where practical vehicle modelling errors (commonly known as \emph{model mismatches}) are present. To address this challenge, we propose a partial end-to-end algorithm that decouples the planning and control tasks. Within this framework, an RL agent generates a trajectory comprising a path and velocity, which is subsequently tracked using a pure pursuit steering controller and a proportional velocity controller, respectively. In contrast, many current learning-based (i.e., reinforcement and imitation learning) algorithms utilise an end-to-end approach whereby a deep neural network directly maps from sensor data to control commands. By leveraging the robustness of a classical controller, our partial end-to-end driving algorithm exhibits better robustness towards model mismatches than standard end-to-end algorithms. |
| title | Partial End-to-end Reinforcement Learning for Robustness Against Modelling Error in Autonomous Racing |
| topic | Robotics Artificial Intelligence |
| url | https://arxiv.org/abs/2312.06406 |