Fourier Transporter: Bi-Equivariant Robotic Manipulation in 3D
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913267022036992 |
|---|---|
| author | Huang, Haojie Howell, Owen Wang, Dian Zhu, Xupeng Walters, Robin Platt, Robert |
| author_facet | Huang, Haojie Howell, Owen Wang, Dian Zhu, Xupeng Walters, Robin Platt, Robert |
| contents | Many complex robotic manipulation tasks can be decomposed as a sequence of pick and place actions. Training a robotic agent to learn this sequence over many different starting conditions typically requires many iterations or demonstrations, especially in 3D environments. In this work, we propose Fourier Transporter (FourTran) which leverages the two-fold SE(d)xSE(d) symmetry in the pick-place problem to achieve much higher sample efficiency. FourTran is an open-loop behavior cloning method trained using expert demonstrations to predict pick-place actions on new environments. FourTran is constrained to incorporate symmetries of the pick and place actions independently. Our method utilizes a fiber space Fourier transformation that allows for memory-efficient construction. We test our proposed network on the RLbench benchmark and achieve state-of-the-art results across various tasks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_12046 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Fourier Transporter: Bi-Equivariant Robotic Manipulation in 3D Huang, Haojie Howell, Owen Wang, Dian Zhu, Xupeng Walters, Robin Platt, Robert Robotics Machine Learning Many complex robotic manipulation tasks can be decomposed as a sequence of pick and place actions. Training a robotic agent to learn this sequence over many different starting conditions typically requires many iterations or demonstrations, especially in 3D environments. In this work, we propose Fourier Transporter (FourTran) which leverages the two-fold SE(d)xSE(d) symmetry in the pick-place problem to achieve much higher sample efficiency. FourTran is an open-loop behavior cloning method trained using expert demonstrations to predict pick-place actions on new environments. FourTran is constrained to incorporate symmetries of the pick and place actions independently. Our method utilizes a fiber space Fourier transformation that allows for memory-efficient construction. We test our proposed network on the RLbench benchmark and achieve state-of-the-art results across various tasks. |
| title | Fourier Transporter: Bi-Equivariant Robotic Manipulation in 3D |
| topic | Robotics Machine Learning |
| url | https://arxiv.org/abs/2401.12046 |