Reconfigurable Intelligent Surface Assisted VEC Based on Multi-Agent Reinforcement Learning
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866915350317105152 |
|---|---|
| author | Qi, Kangwei Wu, Qiong Fan, Pingyi Cheng, Nan Fan, Qiang Wang, Jiangzhou |
| author_facet | Qi, Kangwei Wu, Qiong Fan, Pingyi Cheng, Nan Fan, Qiang Wang, Jiangzhou |
| contents | Vehicular edge computing (VEC) is an emerging technology that enables vehicles to perform high-intensity tasks by executing tasks locally or offloading them to nearby edge devices. However, obstacles such as buildings may degrade the communications and incur communication interruptions, and thus the vehicle may not meet the requirement for task offloading. Reconfigurable intelligent surfaces (RIS) is introduced to support vehicle communication and provide an alternative communication path. The system performance can be improved by flexibly adjusting the phase-shift of the RIS. For RIS-assisted VEC system where tasks arrive randomly, we design a control scheme that considers offloading power, local power allocation and phase-shift optimization. To solve this non-convex problem, we propose a new deep reinforcement learning (DRL) framework that employs modified multi-agent deep deterministic policy gradient (MADDPG) approach to optimize the power allocation for vehicle users (VUs) and block coordinate descent (BCD) algorithm to optimize the phase-shift of the RIS. Simulation results show that our proposed scheme outperforms the centralized deep deterministic policy gradient (DDPG) scheme and random scheme. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_11318 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Reconfigurable Intelligent Surface Assisted VEC Based on Multi-Agent Reinforcement Learning Qi, Kangwei Wu, Qiong Fan, Pingyi Cheng, Nan Fan, Qiang Wang, Jiangzhou Multiagent Systems Distributed, Parallel, and Cluster Computing Machine Learning Networking and Internet Architecture Signal Processing Vehicular edge computing (VEC) is an emerging technology that enables vehicles to perform high-intensity tasks by executing tasks locally or offloading them to nearby edge devices. However, obstacles such as buildings may degrade the communications and incur communication interruptions, and thus the vehicle may not meet the requirement for task offloading. Reconfigurable intelligent surfaces (RIS) is introduced to support vehicle communication and provide an alternative communication path. The system performance can be improved by flexibly adjusting the phase-shift of the RIS. For RIS-assisted VEC system where tasks arrive randomly, we design a control scheme that considers offloading power, local power allocation and phase-shift optimization. To solve this non-convex problem, we propose a new deep reinforcement learning (DRL) framework that employs modified multi-agent deep deterministic policy gradient (MADDPG) approach to optimize the power allocation for vehicle users (VUs) and block coordinate descent (BCD) algorithm to optimize the phase-shift of the RIS. Simulation results show that our proposed scheme outperforms the centralized deep deterministic policy gradient (DDPG) scheme and random scheme. |
| title | Reconfigurable Intelligent Surface Assisted VEC Based on Multi-Agent Reinforcement Learning |
| topic | Multiagent Systems Distributed, Parallel, and Cluster Computing Machine Learning Networking and Internet Architecture Signal Processing |
| url | https://arxiv.org/abs/2406.11318 |