Recent Developments in Machine Learning Methods for Stochastic Control and Games

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Hu, Ruimeng, Laurière, Mathieu
Formato: Preprint
Publicado: 2023
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866913259334926336
author Hu, Ruimeng
Laurière, Mathieu
author_facet Hu, Ruimeng
Laurière, Mathieu
contents Stochastic optimal control and games have a wide range of applications, from finance and economics to social sciences, robotics, and energy management. Many real-world applications involve complex models that have driven the development of sophisticated numerical methods. Recently, computational methods based on machine learning have been developed for solving stochastic control problems and games. In this review, we focus on deep learning methods that have unlocked the possibility of solving such problems, even in high dimensions or when the structure is very complex, beyond what traditional numerical methods can achieve. We consider mostly the continuous time and continuous space setting. Many of the new approaches build on recent neural-network-based methods for solving high-dimensional partial differential equations or backward stochastic differential equations, or on model-free reinforcement learning for Markov decision processes that have led to breakthrough results. This paper provides an introduction to these methods and summarizes the state-of-the-art works at the crossroad of machine learning and stochastic control and games.
format Preprint
id arxiv_https___arxiv_org_abs_2303_10257
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Recent Developments in Machine Learning Methods for Stochastic Control and Games
Hu, Ruimeng
Laurière, Mathieu
Optimization and Control
Machine Learning
Stochastic optimal control and games have a wide range of applications, from finance and economics to social sciences, robotics, and energy management. Many real-world applications involve complex models that have driven the development of sophisticated numerical methods. Recently, computational methods based on machine learning have been developed for solving stochastic control problems and games. In this review, we focus on deep learning methods that have unlocked the possibility of solving such problems, even in high dimensions or when the structure is very complex, beyond what traditional numerical methods can achieve. We consider mostly the continuous time and continuous space setting. Many of the new approaches build on recent neural-network-based methods for solving high-dimensional partial differential equations or backward stochastic differential equations, or on model-free reinforcement learning for Markov decision processes that have led to breakthrough results. This paper provides an introduction to these methods and summarizes the state-of-the-art works at the crossroad of machine learning and stochastic control and games.
title Recent Developments in Machine Learning Methods for Stochastic Control and Games
topic Optimization and Control
Machine Learning
url https://arxiv.org/abs/2303.10257