Deep Reinforcement Learning for Delay-Optimized Task Offloading in Vehicular Fog Computing

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Toopchinezhad, Mohammad Parsa, Ahmadi, Mahmood
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866909342082531328
author Toopchinezhad, Mohammad Parsa
Ahmadi, Mahmood
author_facet Toopchinezhad, Mohammad Parsa
Ahmadi, Mahmood
contents The imminent rise of autonomous vehicles (AVs) is revolutionizing the future of transport. The Vehicular Fog Computing (VFC) paradigm has emerged to alleviate the load of compute-intensive and delay-sensitive AV programs via task offloading to nearby vehicles. Effective VFC requires an intelligent and dynamic offloading algorithm. As a result, this paper adapts Deep Reinforcement Learning (DRL) for VFC offloading. First, a simulation environment utilizing realistic hardware and task specifications, in addition to a novel vehicular movement model based on grid-planned cities, is created. Afterward, a DRL-based algorithm is trained and tested on the environment with the goal of minimizing global task delay. The DRL model displays impressive results, outperforming other greedy and conventional methods. The findings further demonstrate the effectiveness of the DRL model in minimizing queue congestion, especially when compared to traditional cloud computing methods that struggle to handle the demands of a large fleet of vehicles. This is corroborated by queuing theory, highlighting the self-scalability of the VFC-based DRL approach.
format Preprint
id arxiv_https___arxiv_org_abs_2410_03472
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Deep Reinforcement Learning for Delay-Optimized Task Offloading in Vehicular Fog Computing
Toopchinezhad, Mohammad Parsa
Ahmadi, Mahmood
Networking and Internet Architecture
The imminent rise of autonomous vehicles (AVs) is revolutionizing the future of transport. The Vehicular Fog Computing (VFC) paradigm has emerged to alleviate the load of compute-intensive and delay-sensitive AV programs via task offloading to nearby vehicles. Effective VFC requires an intelligent and dynamic offloading algorithm. As a result, this paper adapts Deep Reinforcement Learning (DRL) for VFC offloading. First, a simulation environment utilizing realistic hardware and task specifications, in addition to a novel vehicular movement model based on grid-planned cities, is created. Afterward, a DRL-based algorithm is trained and tested on the environment with the goal of minimizing global task delay. The DRL model displays impressive results, outperforming other greedy and conventional methods. The findings further demonstrate the effectiveness of the DRL model in minimizing queue congestion, especially when compared to traditional cloud computing methods that struggle to handle the demands of a large fleet of vehicles. This is corroborated by queuing theory, highlighting the self-scalability of the VFC-based DRL approach.
title Deep Reinforcement Learning for Delay-Optimized Task Offloading in Vehicular Fog Computing
topic Networking and Internet Architecture
url https://arxiv.org/abs/2410.03472