Unbounded Markov Dynamic Programming with Weighted Supremum Norm Perov Contractions

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
1. Verfasser: Toda, Alexis Akira
Format: Preprint
Veröffentlicht: 2023
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909188291035136
author Toda, Alexis Akira
author_facet Toda, Alexis Akira
contents This paper shows the usefulness of the Perov contraction theorem, which is a generalization of the classical Banach contraction theorem, for solving Markov dynamic programming problems. When the reward function is unbounded, combining an appropriate weighted supremum norm with the Perov contraction theorem yields a unique fixed point of the Bellman operator under weaker conditions than existing approaches. An application to the optimal savings problem shows that the average growth rate condition derived from the spectral radius of a certain nonnegative matrix is sufficient and almost necessary for obtaining a solution.
format Preprint
id arxiv_https___arxiv_org_abs_2310_04593
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Unbounded Markov Dynamic Programming with Weighted Supremum Norm Perov Contractions
Toda, Alexis Akira
Optimization and Control
Theoretical Economics
This paper shows the usefulness of the Perov contraction theorem, which is a generalization of the classical Banach contraction theorem, for solving Markov dynamic programming problems. When the reward function is unbounded, combining an appropriate weighted supremum norm with the Perov contraction theorem yields a unique fixed point of the Bellman operator under weaker conditions than existing approaches. An application to the optimal savings problem shows that the average growth rate condition derived from the spectral radius of a certain nonnegative matrix is sufficient and almost necessary for obtaining a solution.
title Unbounded Markov Dynamic Programming with Weighted Supremum Norm Perov Contractions
topic Optimization and Control
Theoretical Economics
url https://arxiv.org/abs/2310.04593