Continuous time Markov chain based approximation of stationary and weak KAM Hamilton-Jacobi equations

Fuente: arXiv
Saved in:
Bibliographic Details
Main Author: Averboukh, Yurii
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917723367276544
author Averboukh, Yurii
author_facet Averboukh, Yurii
contents Main objects of the paper are stationary and weak KAM Hamilton-Jacobi equations on the finite-dimensional torus. The key idea of the paper is to replace the underlying calculus of variations problems with continuous time Markov decision problems. This directly leads to an approximation of the stationary Hamilton-Jacobi equation by the Bellman equation for a discounting Markov decision problem. Developing elements of the weak KAM theory for the Markov decision problem, we obtain an approximation of the effective Hamiltonian. Additionally, convergences of the functional parts of the discrete weak KAM equations and Mather measures are shown. It turns out that the approximating equations are systems of algebraic equations. Thus, the paper's result can be seen as numerical schemes for stationary and weak KAM Hamilton-Jacobi equations.
format Preprint
id arxiv_https___arxiv_org_abs_2407_11649
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Continuous time Markov chain based approximation of stationary and weak KAM Hamilton-Jacobi equations
Averboukh, Yurii
Analysis of PDEs
Optimization and Control
49L25, 37J51, 60J28, 93E20, 70H09
Main objects of the paper are stationary and weak KAM Hamilton-Jacobi equations on the finite-dimensional torus. The key idea of the paper is to replace the underlying calculus of variations problems with continuous time Markov decision problems. This directly leads to an approximation of the stationary Hamilton-Jacobi equation by the Bellman equation for a discounting Markov decision problem. Developing elements of the weak KAM theory for the Markov decision problem, we obtain an approximation of the effective Hamiltonian. Additionally, convergences of the functional parts of the discrete weak KAM equations and Mather measures are shown. It turns out that the approximating equations are systems of algebraic equations. Thus, the paper's result can be seen as numerical schemes for stationary and weak KAM Hamilton-Jacobi equations.
title Continuous time Markov chain based approximation of stationary and weak KAM Hamilton-Jacobi equations
topic Analysis of PDEs
Optimization and Control
49L25, 37J51, 60J28, 93E20, 70H09
url https://arxiv.org/abs/2407.11649