EgoScale: Scaling Dexterous Manipulation with Diverse Egocentric Human Data
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866917279713722368 |
|---|---|
| author | Zheng, Ruijie Niu, Dantong Xie, Yuqi Wang, Jing Xu, Mengda Jiang, Yunfan Castañeda, Fernando Hu, Fengyuan Tan, You Liang Fu, Letian Darrell, Trevor Huang, Furong Zhu, Yuke Xu, Danfei Fan, Linxi |
| author_facet | Zheng, Ruijie Niu, Dantong Xie, Yuqi Wang, Jing Xu, Mengda Jiang, Yunfan Castañeda, Fernando Hu, Fengyuan Tan, You Liang Fu, Letian Darrell, Trevor Huang, Furong Zhu, Yuke Xu, Danfei Fan, Linxi |
| contents | Human behavior is among the most scalable sources of data for learning physical intelligence, yet how to effectively leverage it for dexterous manipulation remains unclear. While prior work demonstrates human to robot transfer in constrained settings, it is unclear whether large scale human data can support fine grained, high degree of freedom dexterous manipulation. We present EgoScale, a human to dexterous manipulation transfer framework built on large scale egocentric human data. We train a Vision Language Action (VLA) model on over 20,854 hours of action labeled egocentric human video, more than 20 times larger than prior efforts, and uncover a log linear scaling law between human data scale and validation loss. This validation loss strongly correlates with downstream real robot performance, establishing large scale human data as a predictable supervision source. Beyond scale, we introduce a simple two stage transfer recipe: large scale human pretraining followed by lightweight aligned human robot mid training. This enables strong long horizon dexterous manipulation and one shot task adaptation with minimal robot supervision. Our final policy improves average success rate by 54% over a no pretraining baseline using a 22 DoF dexterous robotic hand, and transfers effectively to robots with lower DoF hands, indicating that large scale human motion provides a reusable, embodiment agnostic motor prior. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_16710 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | EgoScale: Scaling Dexterous Manipulation with Diverse Egocentric Human Data Zheng, Ruijie Niu, Dantong Xie, Yuqi Wang, Jing Xu, Mengda Jiang, Yunfan Castañeda, Fernando Hu, Fengyuan Tan, You Liang Fu, Letian Darrell, Trevor Huang, Furong Zhu, Yuke Xu, Danfei Fan, Linxi Robotics Human behavior is among the most scalable sources of data for learning physical intelligence, yet how to effectively leverage it for dexterous manipulation remains unclear. While prior work demonstrates human to robot transfer in constrained settings, it is unclear whether large scale human data can support fine grained, high degree of freedom dexterous manipulation. We present EgoScale, a human to dexterous manipulation transfer framework built on large scale egocentric human data. We train a Vision Language Action (VLA) model on over 20,854 hours of action labeled egocentric human video, more than 20 times larger than prior efforts, and uncover a log linear scaling law between human data scale and validation loss. This validation loss strongly correlates with downstream real robot performance, establishing large scale human data as a predictable supervision source. Beyond scale, we introduce a simple two stage transfer recipe: large scale human pretraining followed by lightweight aligned human robot mid training. This enables strong long horizon dexterous manipulation and one shot task adaptation with minimal robot supervision. Our final policy improves average success rate by 54% over a no pretraining baseline using a 22 DoF dexterous robotic hand, and transfers effectively to robots with lower DoF hands, indicating that large scale human motion provides a reusable, embodiment agnostic motor prior. |
| title | EgoScale: Scaling Dexterous Manipulation with Diverse Egocentric Human Data |
| topic | Robotics |
| url | https://arxiv.org/abs/2602.16710 |