VB-Com: Learning Vision-Blind Composite Humanoid Locomotion Against Deficient Perception

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Ren, Junli, Huang, Tao, Wang, Huayi, Wang, Zirui, Ben, Qingwei, Long, Junfeng, Yang, Yanchao, Pang, Jiangmiao, Luo, Ping
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909631058542592
author Ren, Junli
Huang, Tao
Wang, Huayi
Wang, Zirui
Ben, Qingwei
Long, Junfeng
Yang, Yanchao
Pang, Jiangmiao
Luo, Ping
author_facet Ren, Junli
Huang, Tao
Wang, Huayi
Wang, Zirui
Ben, Qingwei
Long, Junfeng
Yang, Yanchao
Pang, Jiangmiao
Luo, Ping
contents The performance of legged locomotion is closely tied to the accuracy and comprehensiveness of state observations. Blind policies, which rely solely on proprioception, are considered highly robust due to the reliability of proprioceptive observations. However, these policies significantly limit locomotion speed and often require collisions with the terrain to adapt. In contrast, Vision policies allows the robot to plan motions in advance and respond proactively to unstructured terrains with an online perception module. However, perception is often compromised by noisy real-world environments, potential sensor failures, and the limitations of current simulations in presenting dynamic or deformable terrains. Humanoid robots, with high degrees of freedom and inherently unstable morphology, are particularly susceptible to misguidance from deficient perception, which can result in falls or termination on challenging dynamic terrains. To leverage the advantages of both vision and blind policies, we propose VB-Com, a composite framework that enables humanoid robots to determine when to rely on the vision policy and when to switch to the blind policy under perceptual deficiency. We demonstrate that VB-Com effectively enables humanoid robots to traverse challenging terrains and obstacles despite perception deficiencies caused by dynamic terrains or perceptual noise.
format Preprint
id arxiv_https___arxiv_org_abs_2502_14814
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle VB-Com: Learning Vision-Blind Composite Humanoid Locomotion Against Deficient Perception
Ren, Junli
Huang, Tao
Wang, Huayi
Wang, Zirui
Ben, Qingwei
Long, Junfeng
Yang, Yanchao
Pang, Jiangmiao
Luo, Ping
Robotics
The performance of legged locomotion is closely tied to the accuracy and comprehensiveness of state observations. Blind policies, which rely solely on proprioception, are considered highly robust due to the reliability of proprioceptive observations. However, these policies significantly limit locomotion speed and often require collisions with the terrain to adapt. In contrast, Vision policies allows the robot to plan motions in advance and respond proactively to unstructured terrains with an online perception module. However, perception is often compromised by noisy real-world environments, potential sensor failures, and the limitations of current simulations in presenting dynamic or deformable terrains. Humanoid robots, with high degrees of freedom and inherently unstable morphology, are particularly susceptible to misguidance from deficient perception, which can result in falls or termination on challenging dynamic terrains. To leverage the advantages of both vision and blind policies, we propose VB-Com, a composite framework that enables humanoid robots to determine when to rely on the vision policy and when to switch to the blind policy under perceptual deficiency. We demonstrate that VB-Com effectively enables humanoid robots to traverse challenging terrains and obstacles despite perception deficiencies caused by dynamic terrains or perceptual noise.
title VB-Com: Learning Vision-Blind Composite Humanoid Locomotion Against Deficient Perception
topic Robotics
url https://arxiv.org/abs/2502.14814