RecBayes: Recurrent Bayesian Ad Hoc Teamwork in Large Partially Observable Domains

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Ribeiro, João G., Oren, Yaniv, Sardinha, Alberto, Spaan, Matthijs, Melo, Francisco S.
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866908413156392960
author Ribeiro, João G.
Oren, Yaniv
Sardinha, Alberto
Spaan, Matthijs
Melo, Francisco S.
author_facet Ribeiro, João G.
Oren, Yaniv
Sardinha, Alberto
Spaan, Matthijs
Melo, Francisco S.
contents This paper proposes RecBayes, a novel approach for ad hoc teamwork under partial observability, a setting where agents are deployed on-the-fly to environments where pre-existing teams operate, that never requires, at any stage, access to the states of the environment or the actions of its teammates. We show that by relying on a recurrent Bayesian classifier trained using past experiences, an ad hoc agent is effectively able to identify known teams and tasks being performed from observations alone. Unlike recent approaches such as PO-GPL (Gu et al., 2021) and FEAT (Rahman et al., 2023), that require at some stage fully observable states of the environment, actions of teammates, or both, or approaches such as ATPO (Ribeiro et al., 2023) that require the environments to be small enough to be tabularly modelled (Ribeiro et al., 2023), in their work up to 4.8K states and 1.7K observations, we show RecBayes is both able to handle arbitrarily large spaces while never relying on either states and teammates' actions. Our results in benchmark domains from the multi-agent systems literature, adapted for partial observability and scaled up to 1M states and 2^125 observations, show that RecBayes is effective at identifying known teams and tasks being performed from partial observations alone, and as a result, is able to assist the teams in solving the tasks effectively.
format Preprint
id arxiv_https___arxiv_org_abs_2506_15756
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle RecBayes: Recurrent Bayesian Ad Hoc Teamwork in Large Partially Observable Domains
Ribeiro, João G.
Oren, Yaniv
Sardinha, Alberto
Spaan, Matthijs
Melo, Francisco S.
Multiagent Systems
Artificial Intelligence
Machine Learning
This paper proposes RecBayes, a novel approach for ad hoc teamwork under partial observability, a setting where agents are deployed on-the-fly to environments where pre-existing teams operate, that never requires, at any stage, access to the states of the environment or the actions of its teammates. We show that by relying on a recurrent Bayesian classifier trained using past experiences, an ad hoc agent is effectively able to identify known teams and tasks being performed from observations alone. Unlike recent approaches such as PO-GPL (Gu et al., 2021) and FEAT (Rahman et al., 2023), that require at some stage fully observable states of the environment, actions of teammates, or both, or approaches such as ATPO (Ribeiro et al., 2023) that require the environments to be small enough to be tabularly modelled (Ribeiro et al., 2023), in their work up to 4.8K states and 1.7K observations, we show RecBayes is both able to handle arbitrarily large spaces while never relying on either states and teammates' actions. Our results in benchmark domains from the multi-agent systems literature, adapted for partial observability and scaled up to 1M states and 2^125 observations, show that RecBayes is effective at identifying known teams and tasks being performed from partial observations alone, and as a result, is able to assist the teams in solving the tasks effectively.
title RecBayes: Recurrent Bayesian Ad Hoc Teamwork in Large Partially Observable Domains
topic Multiagent Systems
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2506.15756