Fine-Tuning of Neural Network Approximate MPC without Retraining via Bayesian Optimization

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Hose, Henrik, Brunzema, Paul, von Rohr, Alexander, Gräfe, Alexander, Schoellig, Angela P., Trimpe, Sebastian
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866908770416721920
author Hose, Henrik
Brunzema, Paul
von Rohr, Alexander
Gräfe, Alexander
Schoellig, Angela P.
Trimpe, Sebastian
author_facet Hose, Henrik
Brunzema, Paul
von Rohr, Alexander
Gräfe, Alexander
Schoellig, Angela P.
Trimpe, Sebastian
contents Approximate model-predictive control (AMPC) aims to imitate an MPC's behavior with a neural network, removing the need to solve an expensive optimization problem at runtime. However, during deployment, the parameters of the underlying MPC must usually be fine-tuned. This often renders AMPC impractical as it requires repeatedly generating a new dataset and retraining the neural network. Recent work addresses this problem by adapting AMPC without retraining using approximated sensitivities of the MPC's optimization problem. Currently, this adaption must be done by hand, which is labor-intensive and can be unintuitive for high-dimensional systems. To solve this issue, we propose using Bayesian optimization to tune the parameters of AMPC policies based on experimental data. By combining model-based control with direct and local learning, our approach achieves superior performance to nominal AMPC on hardware, with minimal experimentation. This allows automatic and data-efficient adaptation of AMPC to new system instances and fine-tuning to cost functions that are difficult to directly implement in MPC. We demonstrate the proposed method in hardware experiments for the swing-up maneuver on an inverted cartpole and yaw control of an under-actuated balancing unicycle robot, a challenging control problem.
format Preprint
id arxiv_https___arxiv_org_abs_2512_14350
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Fine-Tuning of Neural Network Approximate MPC without Retraining via Bayesian Optimization
Hose, Henrik
Brunzema, Paul
von Rohr, Alexander
Gräfe, Alexander
Schoellig, Angela P.
Trimpe, Sebastian
Robotics
Systems and Control
Approximate model-predictive control (AMPC) aims to imitate an MPC's behavior with a neural network, removing the need to solve an expensive optimization problem at runtime. However, during deployment, the parameters of the underlying MPC must usually be fine-tuned. This often renders AMPC impractical as it requires repeatedly generating a new dataset and retraining the neural network. Recent work addresses this problem by adapting AMPC without retraining using approximated sensitivities of the MPC's optimization problem. Currently, this adaption must be done by hand, which is labor-intensive and can be unintuitive for high-dimensional systems. To solve this issue, we propose using Bayesian optimization to tune the parameters of AMPC policies based on experimental data. By combining model-based control with direct and local learning, our approach achieves superior performance to nominal AMPC on hardware, with minimal experimentation. This allows automatic and data-efficient adaptation of AMPC to new system instances and fine-tuning to cost functions that are difficult to directly implement in MPC. We demonstrate the proposed method in hardware experiments for the swing-up maneuver on an inverted cartpole and yaw control of an under-actuated balancing unicycle robot, a challenging control problem.
title Fine-Tuning of Neural Network Approximate MPC without Retraining via Bayesian Optimization
topic Robotics
Systems and Control
url https://arxiv.org/abs/2512.14350