Learning Hybrid Policies for MPC with Application to Drone Flight in Unknown Dynamic Environments

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Feng, Zhaohan, Chen, Jie, Xiao, Wei, Sun, Jian, Xin, Bin, Wang, Gang
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909082631274496
author Feng, Zhaohan
Chen, Jie
Xiao, Wei
Sun, Jian
Xin, Bin
Wang, Gang
author_facet Feng, Zhaohan
Chen, Jie
Xiao, Wei
Sun, Jian
Xin, Bin
Wang, Gang
contents In recent years, drones have found increased applications in a wide array of real-world tasks. Model predictive control (MPC) has emerged as a practical method for drone flight control, owing to its robustness against modeling errors/uncertainties and external disturbances. However, MPC's sensitivity to manually tuned parameters can lead to rapid performance degradation when faced with unknown environmental dynamics. This paper addresses the challenge of controlling a drone as it traverses a swinging gate characterized by unknown dynamics. This paper introduces a parameterized MPC approach named hyMPC that leverages high-level decision variables to adapt to uncertain environmental conditions. To derive these decision variables, a novel policy search framework aimed at training a high-level Gaussian policy is presented. Subsequently, we harness the power of neural network policies, trained on data gathered through the repeated execution of the Gaussian policy, to provide real-time decision variables. The effectiveness of hyMPC is validated through numerical simulations, achieving a 100\% success rate in 20 drone flight tests traversing a swinging gate, demonstrating its capability to achieve safe and precise flight with limited prior knowledge of environmental dynamics.
format Preprint
id arxiv_https___arxiv_org_abs_2401_09705
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Learning Hybrid Policies for MPC with Application to Drone Flight in Unknown Dynamic Environments
Feng, Zhaohan
Chen, Jie
Xiao, Wei
Sun, Jian
Xin, Bin
Wang, Gang
Robotics
Systems and Control
In recent years, drones have found increased applications in a wide array of real-world tasks. Model predictive control (MPC) has emerged as a practical method for drone flight control, owing to its robustness against modeling errors/uncertainties and external disturbances. However, MPC's sensitivity to manually tuned parameters can lead to rapid performance degradation when faced with unknown environmental dynamics. This paper addresses the challenge of controlling a drone as it traverses a swinging gate characterized by unknown dynamics. This paper introduces a parameterized MPC approach named hyMPC that leverages high-level decision variables to adapt to uncertain environmental conditions. To derive these decision variables, a novel policy search framework aimed at training a high-level Gaussian policy is presented. Subsequently, we harness the power of neural network policies, trained on data gathered through the repeated execution of the Gaussian policy, to provide real-time decision variables. The effectiveness of hyMPC is validated through numerical simulations, achieving a 100\% success rate in 20 drone flight tests traversing a swinging gate, demonstrating its capability to achieve safe and precise flight with limited prior knowledge of environmental dynamics.
title Learning Hybrid Policies for MPC with Application to Drone Flight in Unknown Dynamic Environments
topic Robotics
Systems and Control
url https://arxiv.org/abs/2401.09705