Saved in:
Bibliographic Details
Main Authors: Redondo, Jeffrey, Yuan, Zhenhui, Aslam, Nauman, Zhang, Juan
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2408.03329
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929601670807552
author Redondo, Jeffrey
Yuan, Zhenhui
Aslam, Nauman
Zhang, Juan
author_facet Redondo, Jeffrey
Yuan, Zhenhui
Aslam, Nauman
Zhang, Juan
contents One effective way to optimize the offloading process is by minimizing the transmission time. This is particularly true in a Vehicular Adhoc Network (VANET) where vehicles frequently download and upload High-definition (HD) map data which requires constant updates. This implies that latency and throughput requirements must be guaranteed by the wireless system. To achieve this, adjustable contention windows (CW) allocation strategies in the standard IEEE802.11p have been explored by numerous researchers. Nevertheless, their implementations demand alterations to the existing standard which is not always desirable. To address this issue, we proposed a Q-Learning algorithm that operates at the application layer. Moreover, it could be deployed in any wireless network thereby mitigating the compatibility issues. The solution has demonstrated a better network performance with relatively fewer optimization requirements as compared to the Deep Q Network (DQN) and Actor-Critic algorithms. The same is observed while evaluating the model in a multi-agent setup showing higher performance compared to the single-agent setup.
format Preprint
id arxiv_https___arxiv_org_abs_2408_03329
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Coverage-aware and Reinforcement Learning Using Multi-agent Approach for HD Map QoS in a Realistic Environment
Redondo, Jeffrey
Yuan, Zhenhui
Aslam, Nauman
Zhang, Juan
Networking and Internet Architecture
Artificial Intelligence
Machine Learning
One effective way to optimize the offloading process is by minimizing the transmission time. This is particularly true in a Vehicular Adhoc Network (VANET) where vehicles frequently download and upload High-definition (HD) map data which requires constant updates. This implies that latency and throughput requirements must be guaranteed by the wireless system. To achieve this, adjustable contention windows (CW) allocation strategies in the standard IEEE802.11p have been explored by numerous researchers. Nevertheless, their implementations demand alterations to the existing standard which is not always desirable. To address this issue, we proposed a Q-Learning algorithm that operates at the application layer. Moreover, it could be deployed in any wireless network thereby mitigating the compatibility issues. The solution has demonstrated a better network performance with relatively fewer optimization requirements as compared to the Deep Q Network (DQN) and Actor-Critic algorithms. The same is observed while evaluating the model in a multi-agent setup showing higher performance compared to the single-agent setup.
title Coverage-aware and Reinforcement Learning Using Multi-agent Approach for HD Map QoS in a Realistic Environment
topic Networking and Internet Architecture
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2408.03329