DreamPolicy: A Unified World-model Policy for Scalable Humanoid Locomotion

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Fan, Yahao, Gui, Tianxiang, Ji, Kaiyang, Ding, Shutong, Zhang, Chixuan, Xu, Yifeng, Yang, Ke, Gu, Jiayuan, Yu, Jingyi, Wang, Jingya, Shi, Ye
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916005089902592
author Fan, Yahao
Gui, Tianxiang
Ji, Kaiyang
Ding, Shutong
Zhang, Chixuan
Xu, Yifeng
Yang, Ke
Gu, Jiayuan
Yu, Jingyi
Wang, Jingya
Shi, Ye
author_facet Fan, Yahao
Gui, Tianxiang
Ji, Kaiyang
Ding, Shutong
Zhang, Chixuan
Xu, Yifeng
Yang, Ke
Gu, Jiayuan
Yu, Jingyi
Wang, Jingya
Shi, Ye
contents Achieving versatile humanoid locomotion with a single policy presents a critical scalability challenge. Prevailing methods often rely on distilling multiple terrain-specific teacher policies into a unified student policy. However, while such distillation captures basic locomotion primitives, it struggles to organically compose these skills to adapt to complex environments, resulting in poor generalization to novel composite terrains unseen during training. To overcome this, we present DreamPolicy, a unified framework that integrates offline data with a diffusion-based world model, enabling a single policy to master both known and unseen terrains. Central to our approach is a terrain-aware world model, driven by an autoregressive diffusion world model trained on aggregated rollouts from specialized policies. This model synthesizes physically plausible future trajectories, which serve as dynamic objectives for a conditioned policy, thereby bypassing manual reward engineering. Unlike distillation, our world model captures generalizable locomotion skills, allowing for robust zero-shot transfer to unseen composite terrains. DreamPolicy naturally scales with data availability. As the offline dataset expands, the diffusion world model continuously acquires richer skills. Experiments demonstrate that DreamPolicy outperforms the strongest baseline by up to 27\% on unseen terrains and 38\% on combined terrains. By unifying world model-based planning and policy learning, DreamPolicy breaks the "one task, one policy" bottleneck and establishes a scalable, data-driven paradigm for generalist humanoid control.
format Preprint
id arxiv_https___arxiv_org_abs_2505_18780
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle DreamPolicy: A Unified World-model Policy for Scalable Humanoid Locomotion
Fan, Yahao
Gui, Tianxiang
Ji, Kaiyang
Ding, Shutong
Zhang, Chixuan
Xu, Yifeng
Yang, Ke
Gu, Jiayuan
Yu, Jingyi
Wang, Jingya
Shi, Ye
Robotics
Machine Learning
Achieving versatile humanoid locomotion with a single policy presents a critical scalability challenge. Prevailing methods often rely on distilling multiple terrain-specific teacher policies into a unified student policy. However, while such distillation captures basic locomotion primitives, it struggles to organically compose these skills to adapt to complex environments, resulting in poor generalization to novel composite terrains unseen during training. To overcome this, we present DreamPolicy, a unified framework that integrates offline data with a diffusion-based world model, enabling a single policy to master both known and unseen terrains. Central to our approach is a terrain-aware world model, driven by an autoregressive diffusion world model trained on aggregated rollouts from specialized policies. This model synthesizes physically plausible future trajectories, which serve as dynamic objectives for a conditioned policy, thereby bypassing manual reward engineering. Unlike distillation, our world model captures generalizable locomotion skills, allowing for robust zero-shot transfer to unseen composite terrains. DreamPolicy naturally scales with data availability. As the offline dataset expands, the diffusion world model continuously acquires richer skills. Experiments demonstrate that DreamPolicy outperforms the strongest baseline by up to 27\% on unseen terrains and 38\% on combined terrains. By unifying world model-based planning and policy learning, DreamPolicy breaks the "one task, one policy" bottleneck and establishes a scalable, data-driven paradigm for generalist humanoid control.
title DreamPolicy: A Unified World-model Policy for Scalable Humanoid Locomotion
topic Robotics
Machine Learning
url https://arxiv.org/abs/2505.18780