Cooperative Target Detection with AUVs: A Dual-Timescale Hierarchical MARDL Approach
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866918142428577792 |
|---|---|
| author | Xueyao, Zhang Bo, Yang Zhiwen, Yu Xuelin, Cao Alexandropoulos, George C. Debbah, Merouane Yuen, Chau |
| author_facet | Xueyao, Zhang Bo, Yang Zhiwen, Yu Xuelin, Cao Alexandropoulos, George C. Debbah, Merouane Yuen, Chau |
| contents | Autonomous Underwater Vehicles (AUVs) have shown great potential for cooperative detection and reconnaissance. However, collaborative AUV communications introduce risks of exposure. In adversarial environments, achieving efficient collaboration while ensuring covert operations becomes a key challenge for underwater cooperative missions. In this paper, we propose a novel dual time-scale Hierarchical Multi-Agent Proximal Policy Optimization (H-MAPPO) framework. The high-level component determines the individuals participating in the task based on a central AUV, while the low-level component reduces exposure probabilities through power and trajectory control by the participating AUVs. Simulation results show that the proposed framework achieves rapid convergence, outperforms benchmark algorithms in terms of performance, and maximizes long-term cooperative efficiency while ensuring covert operations. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_13381 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Cooperative Target Detection with AUVs: A Dual-Timescale Hierarchical MARDL Approach Xueyao, Zhang Bo, Yang Zhiwen, Yu Xuelin, Cao Alexandropoulos, George C. Debbah, Merouane Yuen, Chau Robotics Machine Learning Multiagent Systems Autonomous Underwater Vehicles (AUVs) have shown great potential for cooperative detection and reconnaissance. However, collaborative AUV communications introduce risks of exposure. In adversarial environments, achieving efficient collaboration while ensuring covert operations becomes a key challenge for underwater cooperative missions. In this paper, we propose a novel dual time-scale Hierarchical Multi-Agent Proximal Policy Optimization (H-MAPPO) framework. The high-level component determines the individuals participating in the task based on a central AUV, while the low-level component reduces exposure probabilities through power and trajectory control by the participating AUVs. Simulation results show that the proposed framework achieves rapid convergence, outperforms benchmark algorithms in terms of performance, and maximizes long-term cooperative efficiency while ensuring covert operations. |
| title | Cooperative Target Detection with AUVs: A Dual-Timescale Hierarchical MARDL Approach |
| topic | Robotics Machine Learning Multiagent Systems |
| url | https://arxiv.org/abs/2509.13381 |