COMPASS: Cross-embodiment Mobility Policy via Residual RL and Skill Synthesis

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Liu, Wei, Zhao, Huihua, Li, Chenran, Deng, Yuchen, Biswas, Joydeep, Pouya, Soha, Chang, Yan
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914116976771072
author Liu, Wei
Zhao, Huihua
Li, Chenran
Deng, Yuchen
Biswas, Joydeep
Pouya, Soha
Chang, Yan
author_facet Liu, Wei
Zhao, Huihua
Li, Chenran
Deng, Yuchen
Biswas, Joydeep
Pouya, Soha
Chang, Yan
contents As robots are increasingly deployed in diverse application domains, enabling robust mobility across different embodiments has become a critical challenge. Classical mobility stacks, though effective on specific platforms, require extensive per-robot tuning and do not scale easily to new embodiments. Learning-based approaches, such as imitation learning (IL), offer alternatives, but face significant limitations on the need for high-quality demonstrations for each embodiment. To address these challenges, we introduce COMPASS, a unified framework that enables scalable cross-embodiment mobility using expert demonstrations from only a single embodiment. We first pre-train a mobility policy on a single robot using IL, combining a world model with a policy model. We then apply residual reinforcement learning (RL) to efficiently adapt this policy to diverse embodiments through corrective refinements. Finally, we distill specialist policies into a single generalist policy conditioned on an embodiment embedding vector. This design significantly reduces the burden of collecting data while enabling robust generalization across a wide range of robot designs. Our experiments demonstrate that COMPASS scales effectively across diverse robot platforms while maintaining adaptability to various environment configurations, achieving a generalist policy with a success rate approximately 5X higher than the pre-trained IL policy on unseen embodiments, and further demonstrates zero-shot sim-to-real transfer.
format Preprint
id arxiv_https___arxiv_org_abs_2502_16372
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle COMPASS: Cross-embodiment Mobility Policy via Residual RL and Skill Synthesis
Liu, Wei
Zhao, Huihua
Li, Chenran
Deng, Yuchen
Biswas, Joydeep
Pouya, Soha
Chang, Yan
Robotics
As robots are increasingly deployed in diverse application domains, enabling robust mobility across different embodiments has become a critical challenge. Classical mobility stacks, though effective on specific platforms, require extensive per-robot tuning and do not scale easily to new embodiments. Learning-based approaches, such as imitation learning (IL), offer alternatives, but face significant limitations on the need for high-quality demonstrations for each embodiment. To address these challenges, we introduce COMPASS, a unified framework that enables scalable cross-embodiment mobility using expert demonstrations from only a single embodiment. We first pre-train a mobility policy on a single robot using IL, combining a world model with a policy model. We then apply residual reinforcement learning (RL) to efficiently adapt this policy to diverse embodiments through corrective refinements. Finally, we distill specialist policies into a single generalist policy conditioned on an embodiment embedding vector. This design significantly reduces the burden of collecting data while enabling robust generalization across a wide range of robot designs. Our experiments demonstrate that COMPASS scales effectively across diverse robot platforms while maintaining adaptability to various environment configurations, achieving a generalist policy with a success rate approximately 5X higher than the pre-trained IL policy on unseen embodiments, and further demonstrates zero-shot sim-to-real transfer.
title COMPASS: Cross-embodiment Mobility Policy via Residual RL and Skill Synthesis
topic Robotics
url https://arxiv.org/abs/2502.16372