Autonomous Wheel Loader Navigation Using Goal-Conditioned Actor-Critic MPC
Fuente:
arXiv
Salvato in:
| Autori principali: | , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866908302127923200 |
|---|---|
| author | Mäki-Penttilä, Aleksi Toulkani, Naeim Ebrahimi Ghabcheloo, Reza |
| author_facet | Mäki-Penttilä, Aleksi Toulkani, Naeim Ebrahimi Ghabcheloo, Reza |
| contents | This paper proposes a novel control method for an autonomous wheel loader, enabling time-efficient navigation to an arbitrary goal pose. Unlike prior works which combine high-level trajectory planners with Model Predictive Control (MPC), we directly enhance the planning capabilities of MPC by incorporating a cost function derived from Actor-Critic Reinforcement Learning (RL). Specifically, we first train an RL agent to solve the pose reaching task in simulation, then transfer the learned planning knowledge to an MPC by incorporating the trained neural network critic as both the stage and terminal cost. We show through comprehensive simulations that the resulting MPC inherits the time-efficient behavior of the RL agent, generating trajectories that compare favorably against those found using trajectory optimization. We also deploy our method on a real-world wheel loader, where we demonstrate successful navigation in various scenarios. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_15717 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Autonomous Wheel Loader Navigation Using Goal-Conditioned Actor-Critic MPC Mäki-Penttilä, Aleksi Toulkani, Naeim Ebrahimi Ghabcheloo, Reza Robotics Systems and Control This paper proposes a novel control method for an autonomous wheel loader, enabling time-efficient navigation to an arbitrary goal pose. Unlike prior works which combine high-level trajectory planners with Model Predictive Control (MPC), we directly enhance the planning capabilities of MPC by incorporating a cost function derived from Actor-Critic Reinforcement Learning (RL). Specifically, we first train an RL agent to solve the pose reaching task in simulation, then transfer the learned planning knowledge to an MPC by incorporating the trained neural network critic as both the stage and terminal cost. We show through comprehensive simulations that the resulting MPC inherits the time-efficient behavior of the RL agent, generating trajectories that compare favorably against those found using trajectory optimization. We also deploy our method on a real-world wheel loader, where we demonstrate successful navigation in various scenarios. |
| title | Autonomous Wheel Loader Navigation Using Goal-Conditioned Actor-Critic MPC |
| topic | Robotics Systems and Control |
| url | https://arxiv.org/abs/2409.15717 |