Approximate Dynamic Programming with Feasibility Guarantees

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Engelmann, Alexander, Bandeira, Maisa B., Faulwasser, Timm
Formato: Preprint
Publicado: 2023
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909085635444736
author Engelmann, Alexander
Bandeira, Maisa B.
Faulwasser, Timm
author_facet Engelmann, Alexander
Bandeira, Maisa B.
Faulwasser, Timm
contents Safe and economic operation of networked systems is often challenging. Optimization-based schemes are frequently considered, since they achieve near-optimality while ensuring safety via the explicit consideration of constraints. In applications, these schemes, however, often require solving large-scale optimization problems. Iterative techniques from distributed optimization are frequently proposed for complexity reduction. Yet, they achieve feasibility only asymptotically, which induces a substantial computational burden. This work presents an approximate dynamic programming scheme, which is guaranteed to deliver a feasible solution in "one shot", i.e., in one backward-forward iteration over all subproblems provided they are coupled by a tree structure. Our proposed scheme generalizes methods from seemingly disconnected domains such as power systems and optimal control. We demonstrate its efficacy for problems with nonconvex constraints via numerical examples from both domains.
format Preprint
id arxiv_https___arxiv_org_abs_2306_06201
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Approximate Dynamic Programming with Feasibility Guarantees
Engelmann, Alexander
Bandeira, Maisa B.
Faulwasser, Timm
Optimization and Control
Systems and Control
Safe and economic operation of networked systems is often challenging. Optimization-based schemes are frequently considered, since they achieve near-optimality while ensuring safety via the explicit consideration of constraints. In applications, these schemes, however, often require solving large-scale optimization problems. Iterative techniques from distributed optimization are frequently proposed for complexity reduction. Yet, they achieve feasibility only asymptotically, which induces a substantial computational burden. This work presents an approximate dynamic programming scheme, which is guaranteed to deliver a feasible solution in "one shot", i.e., in one backward-forward iteration over all subproblems provided they are coupled by a tree structure. Our proposed scheme generalizes methods from seemingly disconnected domains such as power systems and optimal control. We demonstrate its efficacy for problems with nonconvex constraints via numerical examples from both domains.
title Approximate Dynamic Programming with Feasibility Guarantees
topic Optimization and Control
Systems and Control
url https://arxiv.org/abs/2306.06201