Safe Learning of Locomotion Skills from MPC

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Pua, Xun, Khadiv, Majid
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866917723388248064
author Pua, Xun
Khadiv, Majid
author_facet Pua, Xun
Khadiv, Majid
contents Safe learning of locomotion skills is still an open problem. Indeed, the intrinsically unstable nature of the open-loop dynamics of locomotion systems renders naive learning from scratch prone to catastrophic failures in the real world. In this work, we investigate the use of iterative algorithms to safely learn locomotion skills from model predictive control (MPC). In our framework, we use MPC as an expert and take inspiration from the safe data aggregation (SafeDAGGER) framework to minimize the number of failures during training of the policy. Through a comparison with other standard approaches such as behavior cloning and vanilla DAGGER, we show that not only our approach has a substantially fewer number of failures during training, but the resulting policy is also more robust to external disturbances.
format Preprint
id arxiv_https___arxiv_org_abs_2407_11673
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Safe Learning of Locomotion Skills from MPC
Pua, Xun
Khadiv, Majid
Robotics
Safe learning of locomotion skills is still an open problem. Indeed, the intrinsically unstable nature of the open-loop dynamics of locomotion systems renders naive learning from scratch prone to catastrophic failures in the real world. In this work, we investigate the use of iterative algorithms to safely learn locomotion skills from model predictive control (MPC). In our framework, we use MPC as an expert and take inspiration from the safe data aggregation (SafeDAGGER) framework to minimize the number of failures during training of the policy. Through a comparison with other standard approaches such as behavior cloning and vanilla DAGGER, we show that not only our approach has a substantially fewer number of failures during training, but the resulting policy is also more robust to external disturbances.
title Safe Learning of Locomotion Skills from MPC
topic Robotics
url https://arxiv.org/abs/2407.11673