EMMA: Scaling Mobile Manipulation via Egocentric Human Data

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhu, Lawrence Y., Kuppili, Pranav, Punamiya, Ryan, Aphiwetsa, Patcharapong, Patel, Dhruv, Kareer, Simar, Ha, Sehoon, Xu, Danfei
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918264310857728
author Zhu, Lawrence Y.
Kuppili, Pranav
Punamiya, Ryan
Aphiwetsa, Patcharapong
Patel, Dhruv
Kareer, Simar
Ha, Sehoon
Xu, Danfei
author_facet Zhu, Lawrence Y.
Kuppili, Pranav
Punamiya, Ryan
Aphiwetsa, Patcharapong
Patel, Dhruv
Kareer, Simar
Ha, Sehoon
Xu, Danfei
contents Scaling mobile manipulation imitation learning is bottlenecked by expensive mobile robot teleoperation. We present Egocentric Mobile MAnipulation (EMMA), an end-to-end framework training mobile manipulation policies from human mobile manipulation data with static robot data, sidestepping mobile teleoperation. To accomplish this, we co-train human full-body motion data with static robot data. In our experiments across three real-world tasks, EMMA demonstrates comparable performance to baselines trained on teleoperated mobile robot data (Mobile ALOHA), achieving higher or equivalent task performance in full task success. We find that EMMA is able to generalize to new spatial configurations and scenes, and we observe positive performance scaling as we increase the hours of human data, opening new avenues for scalable robotic learning in real-world environments. Details of this project can be found at https://ego-moma.github.io/.
format Preprint
id arxiv_https___arxiv_org_abs_2509_04443
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle EMMA: Scaling Mobile Manipulation via Egocentric Human Data
Zhu, Lawrence Y.
Kuppili, Pranav
Punamiya, Ryan
Aphiwetsa, Patcharapong
Patel, Dhruv
Kareer, Simar
Ha, Sehoon
Xu, Danfei
Robotics
Scaling mobile manipulation imitation learning is bottlenecked by expensive mobile robot teleoperation. We present Egocentric Mobile MAnipulation (EMMA), an end-to-end framework training mobile manipulation policies from human mobile manipulation data with static robot data, sidestepping mobile teleoperation. To accomplish this, we co-train human full-body motion data with static robot data. In our experiments across three real-world tasks, EMMA demonstrates comparable performance to baselines trained on teleoperated mobile robot data (Mobile ALOHA), achieving higher or equivalent task performance in full task success. We find that EMMA is able to generalize to new spatial configurations and scenes, and we observe positive performance scaling as we increase the hours of human data, opening new avenues for scalable robotic learning in real-world environments. Details of this project can be found at https://ego-moma.github.io/.
title EMMA: Scaling Mobile Manipulation via Egocentric Human Data
topic Robotics
url https://arxiv.org/abs/2509.04443