Data-Driven Predictive Control and MPC: Do we achieve optimality?

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Anand, Akhil S, Sawant, Shambhuraj, Reinhardt, Dirk, Gros, Sebastien
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909212082176000
author Anand, Akhil S
Sawant, Shambhuraj
Reinhardt, Dirk
Gros, Sebastien
author_facet Anand, Akhil S
Sawant, Shambhuraj
Reinhardt, Dirk
Gros, Sebastien
contents In this paper, we explore the interplay between Predictive Control and closed-loop optimality, spanning from Model Predictive Control to Data-Driven Predictive Control. Predictive Control in general relies on some form of prediction scheme on the real system trajectories. However, these predictions may not accurately capture the real system dynamics, for e.g., due to stochasticity, resulting in sub-optimal control policies. This lack of optimality is a critical issue in case of problems with economic objectives. We address this by providing sufficient conditions on the underlying prediction scheme such that a Predictive Controller can achieve closed-loop optimality. However, these conditions do not readily extend to Data-Driven Predictive Control. In this context of closed-loop optimality, we conclude that the factor distinguishing the approaches within Data-Driven Predictive Control is if they can be cast as a sequential decision-making process or not, rather than the dichotomy of model-based vs. model-free. Furthermore, we show that the conventional approach of improving the prediction accuracy from data may not guarantee optimality.
format Preprint
id arxiv_https___arxiv_org_abs_2405_17892
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Data-Driven Predictive Control and MPC: Do we achieve optimality?
Anand, Akhil S
Sawant, Shambhuraj
Reinhardt, Dirk
Gros, Sebastien
Optimization and Control
In this paper, we explore the interplay between Predictive Control and closed-loop optimality, spanning from Model Predictive Control to Data-Driven Predictive Control. Predictive Control in general relies on some form of prediction scheme on the real system trajectories. However, these predictions may not accurately capture the real system dynamics, for e.g., due to stochasticity, resulting in sub-optimal control policies. This lack of optimality is a critical issue in case of problems with economic objectives. We address this by providing sufficient conditions on the underlying prediction scheme such that a Predictive Controller can achieve closed-loop optimality. However, these conditions do not readily extend to Data-Driven Predictive Control. In this context of closed-loop optimality, we conclude that the factor distinguishing the approaches within Data-Driven Predictive Control is if they can be cast as a sequential decision-making process or not, rather than the dichotomy of model-based vs. model-free. Furthermore, we show that the conventional approach of improving the prediction accuracy from data may not guarantee optimality.
title Data-Driven Predictive Control and MPC: Do we achieve optimality?
topic Optimization and Control
url https://arxiv.org/abs/2405.17892