Wireless Agentic AI with Retrieval-Augmented Multimodal Semantic Perception
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909626947076096 |
|---|---|
| author | Liu, Guangyuan Liu, Yinqiu Zhang, Ruichen Du, Hongyang Niyato, Dusit Xiong, Zehui Sun, Sumei Jamalipour, Abbas |
| author_facet | Liu, Guangyuan Liu, Yinqiu Zhang, Ruichen Du, Hongyang Niyato, Dusit Xiong, Zehui Sun, Sumei Jamalipour, Abbas |
| contents | The rapid development of multimodal AI and Large Language Models (LLMs) has greatly enhanced real-time interaction, decision-making, and collaborative tasks. However, in wireless multi-agent scenarios, limited bandwidth poses significant challenges to exchanging semantically rich multimodal information efficiently. Traditional semantic communication methods, though effective, struggle with redundancy and loss of crucial details. To overcome these challenges, we propose a Retrieval-Augmented Multimodal Semantic Communication (RAMSemCom) framework. RAMSemCom incorporates iterative, retrieval-driven semantic refinement tailored for distributed multi-agent environments, enabling efficient exchange of critical multimodal elements through local caching and selective transmission. Our approach dynamically optimizes retrieval using deep reinforcement learning (DRL) to balance semantic fidelity with bandwidth constraints. A comprehensive case study on multi-agent autonomous driving demonstrates that our DRL-based retrieval strategy significantly improves task completion efficiency and reduces communication overhead compared to baseline methods. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_23275 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Wireless Agentic AI with Retrieval-Augmented Multimodal Semantic Perception Liu, Guangyuan Liu, Yinqiu Zhang, Ruichen Du, Hongyang Niyato, Dusit Xiong, Zehui Sun, Sumei Jamalipour, Abbas Networking and Internet Architecture The rapid development of multimodal AI and Large Language Models (LLMs) has greatly enhanced real-time interaction, decision-making, and collaborative tasks. However, in wireless multi-agent scenarios, limited bandwidth poses significant challenges to exchanging semantically rich multimodal information efficiently. Traditional semantic communication methods, though effective, struggle with redundancy and loss of crucial details. To overcome these challenges, we propose a Retrieval-Augmented Multimodal Semantic Communication (RAMSemCom) framework. RAMSemCom incorporates iterative, retrieval-driven semantic refinement tailored for distributed multi-agent environments, enabling efficient exchange of critical multimodal elements through local caching and selective transmission. Our approach dynamically optimizes retrieval using deep reinforcement learning (DRL) to balance semantic fidelity with bandwidth constraints. A comprehensive case study on multi-agent autonomous driving demonstrates that our DRL-based retrieval strategy significantly improves task completion efficiency and reduces communication overhead compared to baseline methods. |
| title | Wireless Agentic AI with Retrieval-Augmented Multimodal Semantic Perception |
| topic | Networking and Internet Architecture |
| url | https://arxiv.org/abs/2505.23275 |