Finite-Horizon Partially Observable Semi-Markov Games with Risk Probability Criteria

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Wen, Xin, Xia, Li, Yu, Zhihui
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866915461480841216
author Wen, Xin
Xia, Li
Yu, Zhihui
author_facet Wen, Xin
Xia, Li
Yu, Zhihui
contents This paper studies partially observable two-person zero-sum semi-Markov games under a probability criterion, in which the system state may not be completely observed. It focuses on the probability that the accumulated rewards of player 1 (i.e., the incurred costs of player 2) fall short of a specified target at the terminal stage, which represents the risk of player 1 and the capacity of player 2. We study the game model via the technology of augmenting state space with the joint conditional distribution of the current unobserved state and the remaining goal. Under a mild condition, we establish a comparison theorem and derive the Shapley equation for the probability criterion. As a consequence, we prove the existence and the uniqueness of the value function and the existence of a Nash equilibrium.
format Preprint
id arxiv_https___arxiv_org_abs_2508_17791
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Finite-Horizon Partially Observable Semi-Markov Games with Risk Probability Criteria
Wen, Xin
Xia, Li
Yu, Zhihui
Optimization and Control
This paper studies partially observable two-person zero-sum semi-Markov games under a probability criterion, in which the system state may not be completely observed. It focuses on the probability that the accumulated rewards of player 1 (i.e., the incurred costs of player 2) fall short of a specified target at the terminal stage, which represents the risk of player 1 and the capacity of player 2. We study the game model via the technology of augmenting state space with the joint conditional distribution of the current unobserved state and the remaining goal. Under a mild condition, we establish a comparison theorem and derive the Shapley equation for the probability criterion. As a consequence, we prove the existence and the uniqueness of the value function and the existence of a Nash equilibrium.
title Finite-Horizon Partially Observable Semi-Markov Games with Risk Probability Criteria
topic Optimization and Control
url https://arxiv.org/abs/2508.17791