DCMAC: Demand-aware Customized Multi-Agent Communication via Upper Bound Training
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866909421673644032 |
|---|---|
| author | Huo, Dongkun Zhang, Huateng Hao, Yixue Ye, Yuanlin Hu, Long Wang, Rui Chen, Min |
| author_facet | Huo, Dongkun Zhang, Huateng Hao, Yixue Ye, Yuanlin Hu, Long Wang, Rui Chen, Min |
| contents | Efficient communication can enhance the overall performance of collaborative multi-agent reinforcement learning. A common approach is to share observations through full communication, leading to significant communication overhead. Existing work attempts to perceive the global state by conducting teammate model based on local information. However, they ignore that the uncertainty generated by prediction may lead to difficult training. To address this problem, we propose a Demand-aware Customized Multi-Agent Communication (DCMAC) protocol, which use an upper bound training to obtain the ideal policy. By utilizing the demand parsing module, agent can interpret the gain of sending local message on teammate, and generate customized messages via compute the correlation between demands and local observation using cross-attention mechanism. Moreover, our method can adapt to the communication resources of agents and accelerate the training progress by appropriating the ideal policy which is trained with joint observation. Experimental results reveal that DCMAC significantly outperforms the baseline algorithms in both unconstrained and communication constrained scenarios. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_07127 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | DCMAC: Demand-aware Customized Multi-Agent Communication via Upper Bound Training Huo, Dongkun Zhang, Huateng Hao, Yixue Ye, Yuanlin Hu, Long Wang, Rui Chen, Min Artificial Intelligence Multiagent Systems Efficient communication can enhance the overall performance of collaborative multi-agent reinforcement learning. A common approach is to share observations through full communication, leading to significant communication overhead. Existing work attempts to perceive the global state by conducting teammate model based on local information. However, they ignore that the uncertainty generated by prediction may lead to difficult training. To address this problem, we propose a Demand-aware Customized Multi-Agent Communication (DCMAC) protocol, which use an upper bound training to obtain the ideal policy. By utilizing the demand parsing module, agent can interpret the gain of sending local message on teammate, and generate customized messages via compute the correlation between demands and local observation using cross-attention mechanism. Moreover, our method can adapt to the communication resources of agents and accelerate the training progress by appropriating the ideal policy which is trained with joint observation. Experimental results reveal that DCMAC significantly outperforms the baseline algorithms in both unconstrained and communication constrained scenarios. |
| title | DCMAC: Demand-aware Customized Multi-Agent Communication via Upper Bound Training |
| topic | Artificial Intelligence Multiagent Systems |
| url | https://arxiv.org/abs/2409.07127 |