A Numerical Truncation Approximation with A Posteriori Error Bounds for the Solution of Poisson's Equation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Mahdian, Saied, Glynn, Peter W., Liu, Yuanyuan
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909085362814976
author Mahdian, Saied
Glynn, Peter W.
Liu, Yuanyuan
author_facet Mahdian, Saied
Glynn, Peter W.
Liu, Yuanyuan
contents The solution to Poisson's equation arise in many Markov chain and Markov jump process settings, including that of the central limit theorem, value functions for average reward Markov decision processes, and within the gradient formula for equilibrium Markovian rewards. In this paper, we consider the problem of numerically computing the solution to Poisson's equation when the state space is infinite or very large. In such settings, the state space must be truncated in order to make the problem computationally tractable. In this paper, we provide the first truncation approximation solution to Poisson's equation that comes with provable and computable a posteriori error bounds. Our theory applies to both discrete-time chains and continuous-time jump processes. Through numerical experiments, we show our method can provide highly accurate solutions and tight bounds.
format Preprint
id arxiv_https___arxiv_org_abs_2401_15905
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A Numerical Truncation Approximation with A Posteriori Error Bounds for the Solution of Poisson's Equation
Mahdian, Saied
Glynn, Peter W.
Liu, Yuanyuan
Probability
Numerical Analysis
The solution to Poisson's equation arise in many Markov chain and Markov jump process settings, including that of the central limit theorem, value functions for average reward Markov decision processes, and within the gradient formula for equilibrium Markovian rewards. In this paper, we consider the problem of numerically computing the solution to Poisson's equation when the state space is infinite or very large. In such settings, the state space must be truncated in order to make the problem computationally tractable. In this paper, we provide the first truncation approximation solution to Poisson's equation that comes with provable and computable a posteriori error bounds. Our theory applies to both discrete-time chains and continuous-time jump processes. Through numerical experiments, we show our method can provide highly accurate solutions and tight bounds.
title A Numerical Truncation Approximation with A Posteriori Error Bounds for the Solution of Poisson's Equation
topic Probability
Numerical Analysis
url https://arxiv.org/abs/2401.15905