Finite Dimensional Projections of HJB Equations in the Wasserstein Space

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Święch, Andrzej, Wessels, Lukas
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866911019144577024
author Święch, Andrzej
Wessels, Lukas
author_facet Święch, Andrzej
Wessels, Lukas
contents This paper continues the study of controlled interacting particle systems with common noise started in [W. Gangbo, S. Mayorga and A. Święch, SIAM J. Math. Anal. 53 (2021), no. 2, 1320--1356] and [S. Mayorga and A. Święch, SIAM J. Control Optim. 61 (2023), no. 2, 820--851]. First, we extend the following results of the previously mentioned works to the case of multiplicative noise: (i) We generalize the convergence of the value functions $u_n$ corresponding to control problems of $n$ particles to the value function $V$ corresponding to an appropriately defined infinite dimensional control problem; (ii) we prove, under certain additional assumptions, $C^{1,1}$ regularity of $V$ in the spatial variable. The second main contribution of the present work is the proof that if $DV$ is continuous (which, in particular, includes the previously proven case of $C^{1,1}$ regularity in the spatial variable), the value function $V$ projects precisely onto the value functions $u_n$. Using this projection property, we show that optimal controls of the finite dimensional problem correspond to optimal controls of the infinite dimensional problem and vice versa. In the case of a linear state equation, we are able to prove that $V$ projects precisely onto the value functions $u_n$ under relaxed assumptions on the coefficients of the cost functional by using approximation techniques in the Wasserstein space, thus covering cases where $V$ may not be differentiable.
format Preprint
id arxiv_https___arxiv_org_abs_2408_07688
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Finite Dimensional Projections of HJB Equations in the Wasserstein Space
Święch, Andrzej
Wessels, Lukas
Optimization and Control
Analysis of PDEs
Probability
28A33, 35D40, 35R15, 49L12, 49L25, 49N80, 93E20
This paper continues the study of controlled interacting particle systems with common noise started in [W. Gangbo, S. Mayorga and A. Święch, SIAM J. Math. Anal. 53 (2021), no. 2, 1320--1356] and [S. Mayorga and A. Święch, SIAM J. Control Optim. 61 (2023), no. 2, 820--851]. First, we extend the following results of the previously mentioned works to the case of multiplicative noise: (i) We generalize the convergence of the value functions $u_n$ corresponding to control problems of $n$ particles to the value function $V$ corresponding to an appropriately defined infinite dimensional control problem; (ii) we prove, under certain additional assumptions, $C^{1,1}$ regularity of $V$ in the spatial variable. The second main contribution of the present work is the proof that if $DV$ is continuous (which, in particular, includes the previously proven case of $C^{1,1}$ regularity in the spatial variable), the value function $V$ projects precisely onto the value functions $u_n$. Using this projection property, we show that optimal controls of the finite dimensional problem correspond to optimal controls of the infinite dimensional problem and vice versa. In the case of a linear state equation, we are able to prove that $V$ projects precisely onto the value functions $u_n$ under relaxed assumptions on the coefficients of the cost functional by using approximation techniques in the Wasserstein space, thus covering cases where $V$ may not be differentiable.
title Finite Dimensional Projections of HJB Equations in the Wasserstein Space
topic Optimization and Control
Analysis of PDEs
Probability
28A33, 35D40, 35R15, 49L12, 49L25, 49N80, 93E20
url https://arxiv.org/abs/2408.07688