Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2402.18002 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910428021391360 |
|---|---|
| author | Nguyen, Hai Kozuno, Tadashi Beltran-Hernandez, Cristian C. Hamaya, Masashi |
| author_facet | Nguyen, Hai Kozuno, Tadashi Beltran-Hernandez, Cristian C. Hamaya, Masashi |
| contents | This study tackles the representative yet challenging contact-rich peg-in-hole task of robotic assembly, using a soft wrist that can operate more safely and tolerate lower-frequency control signals than a rigid one. Previous studies often use a fully observable formulation, requiring external setups or estimators for the peg-to-hole pose. In contrast, we use a partially observable formulation and deep reinforcement learning from demonstrations to learn a memory-based agent that acts purely on haptic and proprioceptive signals. Moreover, previous works do not incorporate potential domain symmetry and thus must search for solutions in a bigger space. Instead, we propose to leverage the symmetry for sample efficiency by augmenting the training data and constructing auxiliary losses to force the agent to adhere to the symmetry. Results in simulation with five different symmetric peg shapes show that our proposed agent can be comparable to or even outperform a state-based agent. In particular, the sample efficiency also allows us to learn directly on the real robot within 3 hours. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_18002 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Symmetry-aware Reinforcement Learning for Robotic Assembly under Partial Observability with a Soft Wrist Nguyen, Hai Kozuno, Tadashi Beltran-Hernandez, Cristian C. Hamaya, Masashi Robotics Artificial Intelligence Machine Learning This study tackles the representative yet challenging contact-rich peg-in-hole task of robotic assembly, using a soft wrist that can operate more safely and tolerate lower-frequency control signals than a rigid one. Previous studies often use a fully observable formulation, requiring external setups or estimators for the peg-to-hole pose. In contrast, we use a partially observable formulation and deep reinforcement learning from demonstrations to learn a memory-based agent that acts purely on haptic and proprioceptive signals. Moreover, previous works do not incorporate potential domain symmetry and thus must search for solutions in a bigger space. Instead, we propose to leverage the symmetry for sample efficiency by augmenting the training data and constructing auxiliary losses to force the agent to adhere to the symmetry. Results in simulation with five different symmetric peg shapes show that our proposed agent can be comparable to or even outperform a state-based agent. In particular, the sample efficiency also allows us to learn directly on the real robot within 3 hours. |
| title | Symmetry-aware Reinforcement Learning for Robotic Assembly under Partial Observability with a Soft Wrist |
| topic | Robotics Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2402.18002 |