Decentralized Planning Using Probabilistic Hyperproperties

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Pontiggia, Francesco, Macák, Filip, Andriushchenko, Roman, Chiari, Michele, Češka, Milan
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916620436242432
author Pontiggia, Francesco
Macák, Filip
Andriushchenko, Roman
Chiari, Michele
Češka, Milan
author_facet Pontiggia, Francesco
Macák, Filip
Andriushchenko, Roman
Chiari, Michele
Češka, Milan
contents Multi-agent planning under stochastic dynamics is usually formalised using decentralized (partially observable) Markov decision processes ( MDPs) and reachability or expected reward specifications. In this paper, we propose a different approach: we use an MDP describing how a single agent operates in an environment and probabilistic hyperproperties to capture desired temporal objectives for a set of decentralized agents operating in the environment. We extend existing approaches for model checking probabilistic hyperproperties to handle temporal formulae relating paths of different agents, thus requiring the self-composition between multiple MDPs. Using several case studies, we demonstrate that our approach provides a flexible and expressive framework to broaden the specification capabilities with respect to existing planning techniques. Additionally, we establish a close connection between a subclass of probabilistic hyperproperties and planning for a particular type of Dec-MDPs, for both of which we show undecidability. This lays the ground for the use of existing decentralized planning tools in the field of probabilistic hyperproperty verification.
format Preprint
id arxiv_https___arxiv_org_abs_2502_13621
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Decentralized Planning Using Probabilistic Hyperproperties
Pontiggia, Francesco
Macák, Filip
Andriushchenko, Roman
Chiari, Michele
Češka, Milan
Logic in Computer Science
Artificial Intelligence
Multi-agent planning under stochastic dynamics is usually formalised using decentralized (partially observable) Markov decision processes ( MDPs) and reachability or expected reward specifications. In this paper, we propose a different approach: we use an MDP describing how a single agent operates in an environment and probabilistic hyperproperties to capture desired temporal objectives for a set of decentralized agents operating in the environment. We extend existing approaches for model checking probabilistic hyperproperties to handle temporal formulae relating paths of different agents, thus requiring the self-composition between multiple MDPs. Using several case studies, we demonstrate that our approach provides a flexible and expressive framework to broaden the specification capabilities with respect to existing planning techniques. Additionally, we establish a close connection between a subclass of probabilistic hyperproperties and planning for a particular type of Dec-MDPs, for both of which we show undecidability. This lays the ground for the use of existing decentralized planning tools in the field of probabilistic hyperproperty verification.
title Decentralized Planning Using Probabilistic Hyperproperties
topic Logic in Computer Science
Artificial Intelligence
url https://arxiv.org/abs/2502.13621