On the Value Function of Convex Bolza Problems Governed by Stochastic Difference Equations

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Álvarez, Sebastián, Deride, Julio, Hermosilla, Cristopher
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866908754104025088
author Álvarez, Sebastián
Deride, Julio
Hermosilla, Cristopher
author_facet Álvarez, Sebastián
Deride, Julio
Hermosilla, Cristopher
contents In this paper we study the value function of Bolza problems governed by stochastic difference equations, with particular emphasis on the convex non-anticipative case. Our goal is to provide some insights on the structure of the subdiferential of the value function. In particular, we establish a connection between the evolution of the subgradients of the value function and a stochastic difference equation of Hamiltonian type. This result can be seen as a transposition of the method of characteristics, introduced by Rockafellar and Wolenski in the 2000s, to the stochastic discrete-time setting. Similarly as done in the literature for the deterministic case, the analysis is based on a duality approach. For this reason we study first a dual representation for the value function in terms of the value function of a dual problem, which is a pseudo Bolza problem. The main difference with the deterministic case is that (due to the non-anticipativity) the symmetry between the Bolza problem and its dual is no longer valid. This in turn implies that ensuring the existence of minimizers for the Bolza problem (which is a key point for establishing the method of characteristics) is not as simple as in the deterministic case, and it should be addressed differently. To complete the exposition, we study the existence of minimizers for a particular class of Bolza problems governed by linear stochastic difference equations, the so-called linear-convex optimal control problems.
format Preprint
id arxiv_https___arxiv_org_abs_2601_05207
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle On the Value Function of Convex Bolza Problems Governed by Stochastic Difference Equations
Álvarez, Sebastián
Deride, Julio
Hermosilla, Cristopher
Optimization and Control
39A50, 93E20, 49J55, 49K45, 49N05
In this paper we study the value function of Bolza problems governed by stochastic difference equations, with particular emphasis on the convex non-anticipative case. Our goal is to provide some insights on the structure of the subdiferential of the value function. In particular, we establish a connection between the evolution of the subgradients of the value function and a stochastic difference equation of Hamiltonian type. This result can be seen as a transposition of the method of characteristics, introduced by Rockafellar and Wolenski in the 2000s, to the stochastic discrete-time setting. Similarly as done in the literature for the deterministic case, the analysis is based on a duality approach. For this reason we study first a dual representation for the value function in terms of the value function of a dual problem, which is a pseudo Bolza problem. The main difference with the deterministic case is that (due to the non-anticipativity) the symmetry between the Bolza problem and its dual is no longer valid. This in turn implies that ensuring the existence of minimizers for the Bolza problem (which is a key point for establishing the method of characteristics) is not as simple as in the deterministic case, and it should be addressed differently. To complete the exposition, we study the existence of minimizers for a particular class of Bolza problems governed by linear stochastic difference equations, the so-called linear-convex optimal control problems.
title On the Value Function of Convex Bolza Problems Governed by Stochastic Difference Equations
topic Optimization and Control
39A50, 93E20, 49J55, 49K45, 49N05
url https://arxiv.org/abs/2601.05207