Autotuning Bipedal Locomotion MPC with GRFM-Net for Efficient Sim-to-Real Transfer

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Chen, Qianzhong, Li, Junheng, Cheng, Sheng, Hovakimyan, Naira, Nguyen, Quan
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914955840716800
author Chen, Qianzhong
Li, Junheng
Cheng, Sheng
Hovakimyan, Naira
Nguyen, Quan
author_facet Chen, Qianzhong
Li, Junheng
Cheng, Sheng
Hovakimyan, Naira
Nguyen, Quan
contents Bipedal locomotion control is essential for humanoid robots to navigate complex, human-centric environments. While optimization-based control designs are popular for integrating sophisticated models of humanoid robots, they often require labor-intensive manual tuning. In this work, we address the challenges of parameter selection in bipedal locomotion control using DiffTune, a model-based autotuning method that leverages differential programming for efficient parameter learning. A major difficulty lies in balancing model fidelity with differentiability. We address this difficulty using a low-fidelity model for differentiability, enhanced by a Ground Reaction Force-and-Moment Network (GRFM-Net) to capture discrepancies between MPC commands and actual control effects. We validate the parameters learned by DiffTune with GRFM-Net in hardware experiments, which demonstrates the parameters' optimality in a multi-objective setting compared with baseline parameters, reducing the total loss by up to 40.5$\%$ compared with the expert-tuned parameters. The results confirm the GRFM-Net's effectiveness in mitigating the sim-to-real gap, improving the transferability of simulation-learned parameters to real hardware.
format Preprint
id arxiv_https___arxiv_org_abs_2409_15710
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Autotuning Bipedal Locomotion MPC with GRFM-Net for Efficient Sim-to-Real Transfer
Chen, Qianzhong
Li, Junheng
Cheng, Sheng
Hovakimyan, Naira
Nguyen, Quan
Robotics
Artificial Intelligence
Systems and Control
Bipedal locomotion control is essential for humanoid robots to navigate complex, human-centric environments. While optimization-based control designs are popular for integrating sophisticated models of humanoid robots, they often require labor-intensive manual tuning. In this work, we address the challenges of parameter selection in bipedal locomotion control using DiffTune, a model-based autotuning method that leverages differential programming for efficient parameter learning. A major difficulty lies in balancing model fidelity with differentiability. We address this difficulty using a low-fidelity model for differentiability, enhanced by a Ground Reaction Force-and-Moment Network (GRFM-Net) to capture discrepancies between MPC commands and actual control effects. We validate the parameters learned by DiffTune with GRFM-Net in hardware experiments, which demonstrates the parameters' optimality in a multi-objective setting compared with baseline parameters, reducing the total loss by up to 40.5$\%$ compared with the expert-tuned parameters. The results confirm the GRFM-Net's effectiveness in mitigating the sim-to-real gap, improving the transferability of simulation-learned parameters to real hardware.
title Autotuning Bipedal Locomotion MPC with GRFM-Net for Efficient Sim-to-Real Transfer
topic Robotics
Artificial Intelligence
Systems and Control
url https://arxiv.org/abs/2409.15710