Some remarks on stochastic converse Lyapunov theorems

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Osinenko, Pavel, Yaremenko, Grigory
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918265900498944
author Osinenko, Pavel
Yaremenko, Grigory
author_facet Osinenko, Pavel
Yaremenko, Grigory
contents In this brief note, we investigate some constructions of Lyapunov functions for stochastic discrete-time stabilizable dynamical systems, in other words, controlled Markov chains. The main question here is whether a Lyapunov function in some statistical sense exists if the respective controlled Markov chain admits a stabilizing policy. We demonstrate some constructions extending on the classical results for deterministic systems. Some limitations of the constructed Lyapunov functions for stabilization are discussed, particularly for stabilization in mean. Although results for deterministic systems are well known, the stochastic case was addressed in less detail, which the current paper remarks on. A distinguishable feature of this work is the study of stabilizers that possess computationally tractable convergence certificates.
format Preprint
id arxiv_https___arxiv_org_abs_2506_06053
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Some remarks on stochastic converse Lyapunov theorems
Osinenko, Pavel
Yaremenko, Grigory
Dynamical Systems
Systems and Control
Optimization and Control
In this brief note, we investigate some constructions of Lyapunov functions for stochastic discrete-time stabilizable dynamical systems, in other words, controlled Markov chains. The main question here is whether a Lyapunov function in some statistical sense exists if the respective controlled Markov chain admits a stabilizing policy. We demonstrate some constructions extending on the classical results for deterministic systems. Some limitations of the constructed Lyapunov functions for stabilization are discussed, particularly for stabilization in mean. Although results for deterministic systems are well known, the stochastic case was addressed in less detail, which the current paper remarks on. A distinguishable feature of this work is the study of stabilizers that possess computationally tractable convergence certificates.
title Some remarks on stochastic converse Lyapunov theorems
topic Dynamical Systems
Systems and Control
Optimization and Control
url https://arxiv.org/abs/2506.06053