Safe Heterogeneous Multi-Agent RL with Communication Regularization for Coordinated Target Acquisition

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Calzolari, Gabriele, Sumathy, Vidya, Kanellakis, Christoforos, Nikolakopoulos, George
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909988740399104
author Calzolari, Gabriele
Sumathy, Vidya
Kanellakis, Christoforos
Nikolakopoulos, George
author_facet Calzolari, Gabriele
Sumathy, Vidya
Kanellakis, Christoforos
Nikolakopoulos, George
contents This paper introduces a decentralized multi-agent reinforcement learning framework enabling structurally heterogeneous teams of agents to jointly discover and acquire randomly located targets in environments characterized by partial observability, communication constraints, and dynamic interactions. Each agent's policy is trained with the Multi-Agent Proximal Policy Optimization algorithm and employs a Graph Attention Network encoder that integrates simulated range-sensing data with communication embeddings exchanged among neighboring agents, enabling context-aware decision-making from both local sensing and relational information. In particular, this work introduces a unified framework that integrates graph-based communication and trajectory-aware safety through safety filters. The architecture is supported by a structured reward formulation designed to encourage effective target discovery and acquisition, collision avoidance, and de-correlation between the agents' communication vectors by promoting informational orthogonality. The effectiveness of the proposed reward function is demonstrated through a comprehensive ablation study. Moreover, simulation results demonstrate safe and stable task execution, confirming the framework's effectiveness.
format Preprint
id arxiv_https___arxiv_org_abs_2601_08327
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Safe Heterogeneous Multi-Agent RL with Communication Regularization for Coordinated Target Acquisition
Calzolari, Gabriele
Sumathy, Vidya
Kanellakis, Christoforos
Nikolakopoulos, George
Robotics
Artificial Intelligence
I.2.9
This paper introduces a decentralized multi-agent reinforcement learning framework enabling structurally heterogeneous teams of agents to jointly discover and acquire randomly located targets in environments characterized by partial observability, communication constraints, and dynamic interactions. Each agent's policy is trained with the Multi-Agent Proximal Policy Optimization algorithm and employs a Graph Attention Network encoder that integrates simulated range-sensing data with communication embeddings exchanged among neighboring agents, enabling context-aware decision-making from both local sensing and relational information. In particular, this work introduces a unified framework that integrates graph-based communication and trajectory-aware safety through safety filters. The architecture is supported by a structured reward formulation designed to encourage effective target discovery and acquisition, collision avoidance, and de-correlation between the agents' communication vectors by promoting informational orthogonality. The effectiveness of the proposed reward function is demonstrated through a comprehensive ablation study. Moreover, simulation results demonstrate safe and stable task execution, confirming the framework's effectiveness.
title Safe Heterogeneous Multi-Agent RL with Communication Regularization for Coordinated Target Acquisition
topic Robotics
Artificial Intelligence
I.2.9
url https://arxiv.org/abs/2601.08327