Expectation in Stochastic Games with Prefix-independent Objectives

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Doyen, Laurent, Gaba, Pranshu, Guha, Shibashis
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913967763357696
author Doyen, Laurent
Gaba, Pranshu
Guha, Shibashis
author_facet Doyen, Laurent
Gaba, Pranshu
Guha, Shibashis
contents Stochastic two-player games model systems with an environment that is both adversarial and stochastic. In this paper, we study the expected value of bounded quantitative prefix-independent objectives in the context of stochastic games. We show a generic reduction from the expectation problem to linearly many instances of the almost-sure satisfaction problem for threshold Boolean objectives. The result follows from partitioning the vertices of the game into so-called value classes where each class consists of vertices of the same value. Our procedure further entails that the memory required by both players to play optimally for the expectation problem is no more than the memory required by the players to play optimally for the almost-sure satisfaction problem for a corresponding threshold Boolean objective. We show the applicability of the framework to compute the expected window mean-payoff measure in stochastic games. The window mean-payoff measure strengthens the classical mean-payoff measure by computing the mean payoff over windows of bounded length that slide along an infinite path. We show that the decision problem to check if the expected window mean-payoff value is at least a given threshold is in UP $\cap$ coUP when the window length is given in unary.
format Preprint
id arxiv_https___arxiv_org_abs_2405_18048
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Expectation in Stochastic Games with Prefix-independent Objectives
Doyen, Laurent
Gaba, Pranshu
Guha, Shibashis
Computer Science and Game Theory
Stochastic two-player games model systems with an environment that is both adversarial and stochastic. In this paper, we study the expected value of bounded quantitative prefix-independent objectives in the context of stochastic games. We show a generic reduction from the expectation problem to linearly many instances of the almost-sure satisfaction problem for threshold Boolean objectives. The result follows from partitioning the vertices of the game into so-called value classes where each class consists of vertices of the same value. Our procedure further entails that the memory required by both players to play optimally for the expectation problem is no more than the memory required by the players to play optimally for the almost-sure satisfaction problem for a corresponding threshold Boolean objective. We show the applicability of the framework to compute the expected window mean-payoff measure in stochastic games. The window mean-payoff measure strengthens the classical mean-payoff measure by computing the mean payoff over windows of bounded length that slide along an infinite path. We show that the decision problem to check if the expected window mean-payoff value is at least a given threshold is in UP $\cap$ coUP when the window length is given in unary.
title Expectation in Stochastic Games with Prefix-independent Objectives
topic Computer Science and Game Theory
url https://arxiv.org/abs/2405.18048