TAG: A Decentralized Framework for Multi-Agent Hierarchical Reinforcement Learning

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Paolo, Giuseppe, Benechehab, Abdelhakim, Cherkaoui, Hamza, Thomas, Albert, Kégl, Balázs
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866929742616199168
author Paolo, Giuseppe
Benechehab, Abdelhakim
Cherkaoui, Hamza
Thomas, Albert
Kégl, Balázs
author_facet Paolo, Giuseppe
Benechehab, Abdelhakim
Cherkaoui, Hamza
Thomas, Albert
Kégl, Balázs
contents Hierarchical organization is fundamental to biological systems and human societies, yet artificial intelligence systems often rely on monolithic architectures that limit adaptability and scalability. Current hierarchical reinforcement learning (HRL) approaches typically restrict hierarchies to two levels or require centralized training, which limits their practical applicability. We introduce TAME Agent Framework (TAG), a framework for constructing fully decentralized hierarchical multi-agent systems. TAG enables hierarchies of arbitrary depth through a novel LevelEnv concept, which abstracts each hierarchy level as the environment for the agents above it. This approach standardizes information flow between levels while preserving loose coupling, allowing for seamless integration of diverse agent types. We demonstrate the effectiveness of TAG by implementing hierarchical architectures that combine different RL agents across multiple levels, achieving improved performance over classical multi-agent RL baselines on standard benchmarks. Our results show that decentralized hierarchical organization enhances both learning speed and final performance, positioning TAG as a promising direction for scalable multi-agent systems.
format Preprint
id arxiv_https___arxiv_org_abs_2502_15425
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle TAG: A Decentralized Framework for Multi-Agent Hierarchical Reinforcement Learning
Paolo, Giuseppe
Benechehab, Abdelhakim
Cherkaoui, Hamza
Thomas, Albert
Kégl, Balázs
Artificial Intelligence
Machine Learning
Systems and Control
Hierarchical organization is fundamental to biological systems and human societies, yet artificial intelligence systems often rely on monolithic architectures that limit adaptability and scalability. Current hierarchical reinforcement learning (HRL) approaches typically restrict hierarchies to two levels or require centralized training, which limits their practical applicability. We introduce TAME Agent Framework (TAG), a framework for constructing fully decentralized hierarchical multi-agent systems. TAG enables hierarchies of arbitrary depth through a novel LevelEnv concept, which abstracts each hierarchy level as the environment for the agents above it. This approach standardizes information flow between levels while preserving loose coupling, allowing for seamless integration of diverse agent types. We demonstrate the effectiveness of TAG by implementing hierarchical architectures that combine different RL agents across multiple levels, achieving improved performance over classical multi-agent RL baselines on standard benchmarks. Our results show that decentralized hierarchical organization enhances both learning speed and final performance, positioning TAG as a promising direction for scalable multi-agent systems.
title TAG: A Decentralized Framework for Multi-Agent Hierarchical Reinforcement Learning
topic Artificial Intelligence
Machine Learning
Systems and Control
url https://arxiv.org/abs/2502.15425