SCDP: Learning Humanoid Locomotion from Partial Observations via Mixed-Observation Distillation

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Carroll, Milo, Peng, Tianhu, Bao, Lingfan, Zhou, Chengxu, Li, Zhibin
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866910047895814144
author Carroll, Milo
Peng, Tianhu
Bao, Lingfan
Zhou, Chengxu
Li, Zhibin
author_facet Carroll, Milo
Peng, Tianhu
Bao, Lingfan
Zhou, Chengxu
Li, Zhibin
contents Distilling humanoid locomotion control from offline datasets into deployable policies remains a challenge, as existing methods rely on privileged full-body states that require complex and often unreliable state estimation. We present Sensor-Conditioned Diffusion Policies (SCDP) that enables humanoid locomotion using only onboard sensors, eliminating the need for explicit state estimation. SCDP decouples sensing from supervision through mixed-observation training: diffusion model conditions on sensor histories while being supervised to predict privileged future state-action trajectories, enforcing the model to infer the motion dynamics under partial observability. We further develop restricted denoising, context distribution alignment, and context-aware attention masking to encourage implicit state estimation within the model and to prevent train-deploy mismatch. We validate SCDP on velocity-commanded locomotion and motion reference tracking tasks. In simulation, SCDP achieves near-perfect success on velocity control (99-100%) and 93% tracking success in AMASS test set, performing comparable to privileged baselines while using only onboard sensors. Finally, we deploy the trained policy on a real G1 humanoid at 50 Hz, demonstrating robust real robot locomotion without external sensing or state estimation.
format Preprint
id arxiv_https___arxiv_org_abs_2603_09574
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle SCDP: Learning Humanoid Locomotion from Partial Observations via Mixed-Observation Distillation
Carroll, Milo
Peng, Tianhu
Bao, Lingfan
Zhou, Chengxu
Li, Zhibin
Robotics
Machine Learning
Distilling humanoid locomotion control from offline datasets into deployable policies remains a challenge, as existing methods rely on privileged full-body states that require complex and often unreliable state estimation. We present Sensor-Conditioned Diffusion Policies (SCDP) that enables humanoid locomotion using only onboard sensors, eliminating the need for explicit state estimation. SCDP decouples sensing from supervision through mixed-observation training: diffusion model conditions on sensor histories while being supervised to predict privileged future state-action trajectories, enforcing the model to infer the motion dynamics under partial observability. We further develop restricted denoising, context distribution alignment, and context-aware attention masking to encourage implicit state estimation within the model and to prevent train-deploy mismatch. We validate SCDP on velocity-commanded locomotion and motion reference tracking tasks. In simulation, SCDP achieves near-perfect success on velocity control (99-100%) and 93% tracking success in AMASS test set, performing comparable to privileged baselines while using only onboard sensors. Finally, we deploy the trained policy on a real G1 humanoid at 50 Hz, demonstrating robust real robot locomotion without external sensing or state estimation.
title SCDP: Learning Humanoid Locomotion from Partial Observations via Mixed-Observation Distillation
topic Robotics
Machine Learning
url https://arxiv.org/abs/2603.09574