Efficient Reinforcement Learning for Jumping Monopods
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917740238864384 |
|---|---|
| author | Bussola, Riccardo Focchi, Michele Del Prete, Andrea Fontanelli, Daniele Palopoli, Luigi |
| author_facet | Bussola, Riccardo Focchi, Michele Del Prete, Andrea Fontanelli, Daniele Palopoli, Luigi |
| contents | In this work, we consider the complex control problem of making a monopod reach a target with a jump. The monopod can jump in any direction and the terrain underneath its foot can be uneven. This is a template of a much larger class of problems, which are extremely challenging and computationally expensive to solve using standard optimisation-based techniques. Reinforcement Learning (RL) could be an interesting alternative, but the application of an end-to-end approach in which the controller must learn everything from scratch, is impractical. The solution advocated in this paper is to guide the learning process within an RL framework by injecting physical knowledge. This expedient brings to widespread benefits, such as a drastic reduction of the learning time, and the ability to learn and compensate for possible errors in the low-level controller executing the motion. We demonstrate the advantage of our approach with respect to both optimization-based and end-to-end RL approaches. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2309_07038 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Efficient Reinforcement Learning for Jumping Monopods Bussola, Riccardo Focchi, Michele Del Prete, Andrea Fontanelli, Daniele Palopoli, Luigi Robotics Artificial Intelligence In this work, we consider the complex control problem of making a monopod reach a target with a jump. The monopod can jump in any direction and the terrain underneath its foot can be uneven. This is a template of a much larger class of problems, which are extremely challenging and computationally expensive to solve using standard optimisation-based techniques. Reinforcement Learning (RL) could be an interesting alternative, but the application of an end-to-end approach in which the controller must learn everything from scratch, is impractical. The solution advocated in this paper is to guide the learning process within an RL framework by injecting physical knowledge. This expedient brings to widespread benefits, such as a drastic reduction of the learning time, and the ability to learn and compensate for possible errors in the low-level controller executing the motion. We demonstrate the advantage of our approach with respect to both optimization-based and end-to-end RL approaches. |
| title | Efficient Reinforcement Learning for Jumping Monopods |
| topic | Robotics Artificial Intelligence |
| url | https://arxiv.org/abs/2309.07038 |