Two-Stage Learning of Highly Dynamic Motions with Rigid and Articulated Soft Quadrupeds
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917602125676544 |
|---|---|
| author | Vezzi, Francecso Ding, Jiatao Raffin, Antonin Kober, Jens Della Santina, Cosimo |
| author_facet | Vezzi, Francecso Ding, Jiatao Raffin, Antonin Kober, Jens Della Santina, Cosimo |
| contents | Controlled execution of dynamic motions in quadrupedal robots, especially those with articulated soft bodies, presents a unique set of challenges that traditional methods struggle to address efficiently. In this study, we tackle these issues by relying on a simple yet effective two-stage learning framework to generate dynamic motions for quadrupedal robots. First, a gradient-free evolution strategy is employed to discover simply represented control policies, eliminating the need for a predefined reference motion. Then, we refine these policies using deep reinforcement learning. Our approach enables the acquisition of complex motions like pronking and back-flipping, effectively from scratch. Additionally, our method simplifies the traditionally labour-intensive task of reward shaping, boosting the efficiency of the learning process. Importantly, our framework proves particularly effective for articulated soft quadrupeds, whose inherent compliance and adaptability make them ideal for dynamic tasks but also introduce unique control challenges. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2309_09682 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Two-Stage Learning of Highly Dynamic Motions with Rigid and Articulated Soft Quadrupeds Vezzi, Francecso Ding, Jiatao Raffin, Antonin Kober, Jens Della Santina, Cosimo Robotics Controlled execution of dynamic motions in quadrupedal robots, especially those with articulated soft bodies, presents a unique set of challenges that traditional methods struggle to address efficiently. In this study, we tackle these issues by relying on a simple yet effective two-stage learning framework to generate dynamic motions for quadrupedal robots. First, a gradient-free evolution strategy is employed to discover simply represented control policies, eliminating the need for a predefined reference motion. Then, we refine these policies using deep reinforcement learning. Our approach enables the acquisition of complex motions like pronking and back-flipping, effectively from scratch. Additionally, our method simplifies the traditionally labour-intensive task of reward shaping, boosting the efficiency of the learning process. Importantly, our framework proves particularly effective for articulated soft quadrupeds, whose inherent compliance and adaptability make them ideal for dynamic tasks but also introduce unique control challenges. |
| title | Two-Stage Learning of Highly Dynamic Motions with Rigid and Articulated Soft Quadrupeds |
| topic | Robotics |
| url | https://arxiv.org/abs/2309.09682 |