R3D: Revisiting 3D Policy Learning
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2026
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866918450769690624 |
|---|---|
| author | Hong, Zhengdong Wu, Shenrui Cui, Haozhe Zhao, Boyi Ji, Ran He, Yiyang Zhang, Hangxing Ke, Zundong Wang, Jun Zhang, Guofeng Gu, Jiayuan |
| author_facet | Hong, Zhengdong Wu, Shenrui Cui, Haozhe Zhao, Boyi Ji, Ran He, Yiyang Zhang, Hangxing Ke, Zundong Wang, Jun Zhang, Guofeng Gu, Jiayuan |
| contents | 3D policy learning promises superior generalization and cross-embodiment transfer, but progress has been hindered by training instabilities and severe overfitting, precluding the adoption of powerful 3D perception models. In this work, we systematically diagnose these failures, identifying the omission of 3D data augmentation and the adverse effects of Batch Normalization as primary causes. We propose a new architecture coupling a scalable transformer-based 3D encoder with a diffusion decoder, engineered specifically for stability at scale and designed to leverage large-scale pre-training. Our approach significantly outperforms state-of-the-art 3D baselines on challenging manipulation benchmarks, establishing a new and robust foundation for scalable 3D imitation learning. Project Page: https://r3d-policy.github.io/ |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_15281 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | R3D: Revisiting 3D Policy Learning Hong, Zhengdong Wu, Shenrui Cui, Haozhe Zhao, Boyi Ji, Ran He, Yiyang Zhang, Hangxing Ke, Zundong Wang, Jun Zhang, Guofeng Gu, Jiayuan Computer Vision and Pattern Recognition Robotics 3D policy learning promises superior generalization and cross-embodiment transfer, but progress has been hindered by training instabilities and severe overfitting, precluding the adoption of powerful 3D perception models. In this work, we systematically diagnose these failures, identifying the omission of 3D data augmentation and the adverse effects of Batch Normalization as primary causes. We propose a new architecture coupling a scalable transformer-based 3D encoder with a diffusion decoder, engineered specifically for stability at scale and designed to leverage large-scale pre-training. Our approach significantly outperforms state-of-the-art 3D baselines on challenging manipulation benchmarks, establishing a new and robust foundation for scalable 3D imitation learning. Project Page: https://r3d-policy.github.io/ |
| title | R3D: Revisiting 3D Policy Learning |
| topic | Computer Vision and Pattern Recognition Robotics |
| url | https://arxiv.org/abs/2604.15281 |