Saved in:
Bibliographic Details
Main Authors: Davey, Ashley, Zheng, Harry
Format: Preprint
Published: 2020
Subjects:
Online Access:https://arxiv.org/abs/2008.11757
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910646532046848
author Davey, Ashley
Zheng, Harry
author_facet Davey, Ashley
Zheng, Harry
contents This paper proposes two algorithms for solving stochastic control problems with deep learning, with a focus on the utility maximisation problem. The first algorithm solves Markovian problems via the Hamilton Jacobi Bellman (HJB) equation. We solve this highly nonlinear partial differential equation (PDE) with a second order backward stochastic differential equation (2BSDE) formulation. The convex structure of the problem allows us to describe a dual problem that can either verify the original primal approach or bypass some of the complexity. The second algorithm utilises the full power of the duality method to solve non-Markovian problems, which are often beyond the scope of stochastic control solvers in the existing literature. We solve an adjoint BSDE that satisfies the dual optimality conditions. We apply these algorithms to problems with power, log and non-HARA utilities in the Black-Scholes, the Heston stochastic volatility, and path dependent volatility models. Numerical experiments show highly accurate results with low computational cost, supporting our proposed algorithms.
format Preprint
id arxiv_https___arxiv_org_abs_2008_11757
institution arXiv
publishDate 2020
record_format arxiv
spellingShingle Deep Learning for Constrained Utility Maximisation
Davey, Ashley
Zheng, Harry
Computational Finance
Machine Learning
Optimization and Control
93E20, 91G80, 90C46, 49M29
This paper proposes two algorithms for solving stochastic control problems with deep learning, with a focus on the utility maximisation problem. The first algorithm solves Markovian problems via the Hamilton Jacobi Bellman (HJB) equation. We solve this highly nonlinear partial differential equation (PDE) with a second order backward stochastic differential equation (2BSDE) formulation. The convex structure of the problem allows us to describe a dual problem that can either verify the original primal approach or bypass some of the complexity. The second algorithm utilises the full power of the duality method to solve non-Markovian problems, which are often beyond the scope of stochastic control solvers in the existing literature. We solve an adjoint BSDE that satisfies the dual optimality conditions. We apply these algorithms to problems with power, log and non-HARA utilities in the Black-Scholes, the Heston stochastic volatility, and path dependent volatility models. Numerical experiments show highly accurate results with low computational cost, supporting our proposed algorithms.
title Deep Learning for Constrained Utility Maximisation
topic Computational Finance
Machine Learning
Optimization and Control
93E20, 91G80, 90C46, 49M29
url https://arxiv.org/abs/2008.11757