Enhancing Aerial Combat Tactics through Hierarchical Multi-Agent Reinforcement Learning
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866916735908577280 |
|---|---|
| author | Selmonaj, Ardian Szehr, Oleg Del Rio, Giacomo Antonucci, Alessandro Schneider, Adrian Rüegsegger, Michael |
| author_facet | Selmonaj, Ardian Szehr, Oleg Del Rio, Giacomo Antonucci, Alessandro Schneider, Adrian Rüegsegger, Michael |
| contents | This work presents a Hierarchical Multi-Agent Reinforcement Learning framework for analyzing simulated air combat scenarios involving heterogeneous agents. The objective is to identify effective Courses of Action that lead to mission success within preset simulations, thereby enabling the exploration of real-world defense scenarios at low cost and in a safe-to-fail setting. Applying deep Reinforcement Learning in this context poses specific challenges, such as complex flight dynamics, the exponential size of the state and action spaces in multi-agent systems, and the capability to integrate real-time control of individual units with look-ahead planning. To address these challenges, the decision-making process is split into two levels of abstraction: low-level policies control individual units, while a high-level commander policy issues macro commands aligned with the overall mission targets. This hierarchical structure facilitates the training process by exploiting policy symmetries of individual agents and by separating control from command tasks. The low-level policies are trained for individual combat control in a curriculum of increasing complexity. The high-level commander is then trained on mission targets given pre-trained control policies. The empirical validation confirms the advantages of the proposed framework. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_08995 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Enhancing Aerial Combat Tactics through Hierarchical Multi-Agent Reinforcement Learning Selmonaj, Ardian Szehr, Oleg Del Rio, Giacomo Antonucci, Alessandro Schneider, Adrian Rüegsegger, Michael Artificial Intelligence Machine Learning Multiagent Systems Robotics This work presents a Hierarchical Multi-Agent Reinforcement Learning framework for analyzing simulated air combat scenarios involving heterogeneous agents. The objective is to identify effective Courses of Action that lead to mission success within preset simulations, thereby enabling the exploration of real-world defense scenarios at low cost and in a safe-to-fail setting. Applying deep Reinforcement Learning in this context poses specific challenges, such as complex flight dynamics, the exponential size of the state and action spaces in multi-agent systems, and the capability to integrate real-time control of individual units with look-ahead planning. To address these challenges, the decision-making process is split into two levels of abstraction: low-level policies control individual units, while a high-level commander policy issues macro commands aligned with the overall mission targets. This hierarchical structure facilitates the training process by exploiting policy symmetries of individual agents and by separating control from command tasks. The low-level policies are trained for individual combat control in a curriculum of increasing complexity. The high-level commander is then trained on mission targets given pre-trained control policies. The empirical validation confirms the advantages of the proposed framework. |
| title | Enhancing Aerial Combat Tactics through Hierarchical Multi-Agent Reinforcement Learning |
| topic | Artificial Intelligence Machine Learning Multiagent Systems Robotics |
| url | https://arxiv.org/abs/2505.08995 |