On the Role of the Action Space in Robot Manipulation Learning and Sim-to-Real Transfer
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2023
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866907899519827968 |
|---|---|
| author | Aljalbout, Elie Frank, Felix Karl, Maximilian van der Smagt, Patrick |
| author_facet | Aljalbout, Elie Frank, Felix Karl, Maximilian van der Smagt, Patrick |
| contents | We study the choice of action space in robot manipulation learning and sim-to-real transfer. We define metrics that assess the performance, and examine the emerging properties in the different action spaces. We train over 250 reinforcement learning~(RL) agents in simulated reaching and pushing tasks, using 13 different control spaces. The choice of spaces spans combinations of common action space design characteristics. We evaluate the training performance in simulation and the transfer to a real-world environment. We identify good and bad characteristics of robotic action spaces and make recommendations for future designs. Our findings have important implications for the design of RL algorithms for robot manipulation tasks, and highlight the need for careful consideration of action spaces when training and transferring RL agents for real-world robotics. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2312_03673 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | On the Role of the Action Space in Robot Manipulation Learning and Sim-to-Real Transfer Aljalbout, Elie Frank, Felix Karl, Maximilian van der Smagt, Patrick Robotics Machine Learning We study the choice of action space in robot manipulation learning and sim-to-real transfer. We define metrics that assess the performance, and examine the emerging properties in the different action spaces. We train over 250 reinforcement learning~(RL) agents in simulated reaching and pushing tasks, using 13 different control spaces. The choice of spaces spans combinations of common action space design characteristics. We evaluate the training performance in simulation and the transfer to a real-world environment. We identify good and bad characteristics of robotic action spaces and make recommendations for future designs. Our findings have important implications for the design of RL algorithms for robot manipulation tasks, and highlight the need for careful consideration of action spaces when training and transferring RL agents for real-world robotics. |
| title | On the Role of the Action Space in Robot Manipulation Learning and Sim-to-Real Transfer |
| topic | Robotics Machine Learning |
| url | https://arxiv.org/abs/2312.03673 |