Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Su, Haokai, Luo, Haoxiang, Yang, Shunpeng, Jiang, Kaiwen, Zhang, Wei, Chen, Hua
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:https://arxiv.org/abs/2509.09106
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866915562698833920
author Su, Haokai
Luo, Haoxiang
Yang, Shunpeng
Jiang, Kaiwen
Zhang, Wei
Chen, Hua
author_facet Su, Haokai
Luo, Haoxiang
Yang, Shunpeng
Jiang, Kaiwen
Zhang, Wei
Chen, Hua
contents Achieving stable and robust perceptive locomotion for bipedal robots in unstructured outdoor environments remains a critical challenge due to complex terrain geometry and susceptibility to external disturbances. In this work, we propose a novel reward design inspired by the Linear Inverted Pendulum Model (LIPM) to enable perceptive and stable locomotion in the wild. The LIPM provides theoretical guidance for dynamic balance by regulating the center of mass (CoM) height and the torso orientation. These are key factors for terrain-aware locomotion, as they help ensure a stable viewpoint for the robot's camera. Building on this insight, we design a reward function that promotes balance and dynamic stability while encouraging accurate CoM trajectory tracking. To adaptively trade off between velocity tracking and stability, we leverage the Reward Fusion Module (RFM) approach that prioritizes stability when needed. A double-critic architecture is adopted to separately evaluate stability and locomotion objectives, improving training efficiency and robustness. We validate our approach through extensive experiments on a bipedal robot in both simulation and real-world outdoor environments. The results demonstrate superior terrain adaptability, disturbance rejection, and consistent performance across a wide range of speeds and perceptual conditions.
format Preprint
id arxiv_https___arxiv_org_abs_2509_09106
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle LIPM-Guided Reinforcement Learning for Stable and Perceptive Locomotion in Bipedal Robots
Su, Haokai
Luo, Haoxiang
Yang, Shunpeng
Jiang, Kaiwen
Zhang, Wei
Chen, Hua
Robotics
Achieving stable and robust perceptive locomotion for bipedal robots in unstructured outdoor environments remains a critical challenge due to complex terrain geometry and susceptibility to external disturbances. In this work, we propose a novel reward design inspired by the Linear Inverted Pendulum Model (LIPM) to enable perceptive and stable locomotion in the wild. The LIPM provides theoretical guidance for dynamic balance by regulating the center of mass (CoM) height and the torso orientation. These are key factors for terrain-aware locomotion, as they help ensure a stable viewpoint for the robot's camera. Building on this insight, we design a reward function that promotes balance and dynamic stability while encouraging accurate CoM trajectory tracking. To adaptively trade off between velocity tracking and stability, we leverage the Reward Fusion Module (RFM) approach that prioritizes stability when needed. A double-critic architecture is adopted to separately evaluate stability and locomotion objectives, improving training efficiency and robustness. We validate our approach through extensive experiments on a bipedal robot in both simulation and real-world outdoor environments. The results demonstrate superior terrain adaptability, disturbance rejection, and consistent performance across a wide range of speeds and perceptual conditions.
title LIPM-Guided Reinforcement Learning for Stable and Perceptive Locomotion in Bipedal Robots
topic Robotics
url https://arxiv.org/abs/2509.09106