A numerical method to simulate the stochastic linear-quadratic optimal control problem with control constraint in higher dimensions

Fuente: arXiv
Saved in:
Bibliographic Details
Main Author: Chaudhary, Abhishek
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915059182075904
author Chaudhary, Abhishek
author_facet Chaudhary, Abhishek
contents We propose an {\em implementable} numerical scheme for the discretization of linear-quadratic optimal control problems involving SDEs in higher dimensions with {\em control constraint}. For time discretization, we employ the implicit Euler scheme, deriving discrete optimality conditions that involve time discretization of a backward stochastic differential equations. We develop a recursive formula to compute conditional expectations in the time discretization of the BSDE whose computation otherwise is the most computationally demanding step. Additionally, we present the error analysis for the rate of convergence. We provide numerical examples to demonstrate the efficiency of our scheme in higher dimensions.
format Preprint
id arxiv_https___arxiv_org_abs_2412_08553
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A numerical method to simulate the stochastic linear-quadratic optimal control problem with control constraint in higher dimensions
Chaudhary, Abhishek
Analysis of PDEs
49J20, 65M60, 65M25, 35R60, 60H15, 60H35, 93E20
We propose an {\em implementable} numerical scheme for the discretization of linear-quadratic optimal control problems involving SDEs in higher dimensions with {\em control constraint}. For time discretization, we employ the implicit Euler scheme, deriving discrete optimality conditions that involve time discretization of a backward stochastic differential equations. We develop a recursive formula to compute conditional expectations in the time discretization of the BSDE whose computation otherwise is the most computationally demanding step. Additionally, we present the error analysis for the rate of convergence. We provide numerical examples to demonstrate the efficiency of our scheme in higher dimensions.
title A numerical method to simulate the stochastic linear-quadratic optimal control problem with control constraint in higher dimensions
topic Analysis of PDEs
49J20, 65M60, 65M25, 35R60, 60H15, 60H35, 93E20
url https://arxiv.org/abs/2412.08553