Robust RL Control for Bipedal Locomotion with Closed Kinematic Chains

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Maslennikov, Egor, Zaliaev, Eduard, Dudorov, Nikita, Shamanin, Oleg, Dmitry, Karanov, Afanasev, Gleb, Burkov, Alexey, Lygin, Egor, Nedelchev, Simeon, Ponomarev, Evgeny
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913939939393536
author Maslennikov, Egor
Zaliaev, Eduard
Dudorov, Nikita
Shamanin, Oleg
Dmitry, Karanov
Afanasev, Gleb
Burkov, Alexey
Lygin, Egor
Nedelchev, Simeon
Ponomarev, Evgeny
author_facet Maslennikov, Egor
Zaliaev, Eduard
Dudorov, Nikita
Shamanin, Oleg
Dmitry, Karanov
Afanasev, Gleb
Burkov, Alexey
Lygin, Egor
Nedelchev, Simeon
Ponomarev, Evgeny
contents Developing robust locomotion controllers for bipedal robots with closed kinematic chains presents unique challenges, particularly since most reinforcement learning (RL) approaches simplify these parallel mechanisms into serial models during training. We demonstrate that this simplification significantly impairs sim-to-real transfer by failing to capture essential aspects such as joint coupling, friction dynamics, and motor-space control characteristics. In this work, we present an RL framework that explicitly incorporates closed-chain dynamics and validate it on our custom-built robot TopA. Our approach enhances policy robustness through symmetry-aware loss functions, adversarial training, and targeted network regularization. Experimental results demonstrate that our integrated approach achieves stable locomotion across diverse terrains, significantly outperforming methods based on simplified kinematic models.
format Preprint
id arxiv_https___arxiv_org_abs_2507_10164
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Robust RL Control for Bipedal Locomotion with Closed Kinematic Chains
Maslennikov, Egor
Zaliaev, Eduard
Dudorov, Nikita
Shamanin, Oleg
Dmitry, Karanov
Afanasev, Gleb
Burkov, Alexey
Lygin, Egor
Nedelchev, Simeon
Ponomarev, Evgeny
Robotics
Developing robust locomotion controllers for bipedal robots with closed kinematic chains presents unique challenges, particularly since most reinforcement learning (RL) approaches simplify these parallel mechanisms into serial models during training. We demonstrate that this simplification significantly impairs sim-to-real transfer by failing to capture essential aspects such as joint coupling, friction dynamics, and motor-space control characteristics. In this work, we present an RL framework that explicitly incorporates closed-chain dynamics and validate it on our custom-built robot TopA. Our approach enhances policy robustness through symmetry-aware loss functions, adversarial training, and targeted network regularization. Experimental results demonstrate that our integrated approach achieves stable locomotion across diverse terrains, significantly outperforming methods based on simplified kinematic models.
title Robust RL Control for Bipedal Locomotion with Closed Kinematic Chains
topic Robotics
url https://arxiv.org/abs/2507.10164