Sampling Strategies for Robust Universal Quadrupedal Locomotion Policies

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Rytz, David, Ly, Kim Tien, Havoutis, Ioannis
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912636135800832
author Rytz, David
Ly, Kim Tien
Havoutis, Ioannis
author_facet Rytz, David
Ly, Kim Tien
Havoutis, Ioannis
contents This work focuses on sampling strategies of configuration variations for generating robust universal locomotion policies for quadrupedal robots. We investigate the effects of sampling physical robot parameters and joint proportional-derivative gains to enable training a single reinforcement learning policy that generalizes to multiple parameter configurations. Three fundamental joint gain sampling strategies are compared: parameter sampling with (1) linear and polynomial function mappings of mass-to-gains, (2) performance-based adaptive filtering, and (3) uniform random sampling. We improve the robustness of the policy by biasing the configurations using nominal priors and reference models. All training was conducted on RaiSim, tested in simulation on a range of diverse quadrupeds, and zero-shot deployed onto hardware using the ANYmal quadruped robot. Compared to multiple baseline implementations, our results demonstrate the need for significant joint controller gains randomization for robust closing of the sim-to-real gap.
format Preprint
id arxiv_https___arxiv_org_abs_2510_07094
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Sampling Strategies for Robust Universal Quadrupedal Locomotion Policies
Rytz, David
Ly, Kim Tien
Havoutis, Ioannis
Robotics
This work focuses on sampling strategies of configuration variations for generating robust universal locomotion policies for quadrupedal robots. We investigate the effects of sampling physical robot parameters and joint proportional-derivative gains to enable training a single reinforcement learning policy that generalizes to multiple parameter configurations. Three fundamental joint gain sampling strategies are compared: parameter sampling with (1) linear and polynomial function mappings of mass-to-gains, (2) performance-based adaptive filtering, and (3) uniform random sampling. We improve the robustness of the policy by biasing the configurations using nominal priors and reference models. All training was conducted on RaiSim, tested in simulation on a range of diverse quadrupeds, and zero-shot deployed onto hardware using the ANYmal quadruped robot. Compared to multiple baseline implementations, our results demonstrate the need for significant joint controller gains randomization for robust closing of the sim-to-real gap.
title Sampling Strategies for Robust Universal Quadrupedal Locomotion Policies
topic Robotics
url https://arxiv.org/abs/2510.07094