DeepEdge: A Deep Reinforcement Learning based Task Orchestrator for Edge Computing

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Yamansavascilar, Baris, Baktir, Ahmet Cihat, Sonmez, Cagatay, Ozgovde, Atay, Ersoy, Cem
Formato: Preprint
Publicado: 2021
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866913702173736960
author Yamansavascilar, Baris
Baktir, Ahmet Cihat
Sonmez, Cagatay
Ozgovde, Atay
Ersoy, Cem
author_facet Yamansavascilar, Baris
Baktir, Ahmet Cihat
Sonmez, Cagatay
Ozgovde, Atay
Ersoy, Cem
contents The improvements in the edge computing technology pave the road for diversified applications that demand real-time interaction. However, due to the mobility of the end-users and the dynamic edge environment, it becomes challenging to handle the task offloading with high performance. Moreover, since each application in mobile devices has different characteristics, a task orchestrator must be adaptive and have the ability to learn the dynamics of the environment. For this purpose, we develop a deep reinforcement learning based task orchestrator, DeepEdge, which learns to meet different task requirements without needing human interaction even under the heavily-loaded stochastic network conditions in terms of mobile users and applications. Given the dynamic offloading requests and time-varying communication conditions, we successfully model the problem as a Markov process and then apply the Double Deep Q-Network (DDQN) algorithm to implement DeepEdge. To evaluate the robustness of DeepEdge, we experiment with four different applications including image rendering, infotainment, pervasive health, and augmented reality in the network under various loads. Furthermore, we compare the performance of our agent with the four different task offloading approaches in the literature. Our results show that DeepEdge outperforms its competitors in terms of the percentage of satisfactorily completed tasks.
format Preprint
id arxiv_https___arxiv_org_abs_2110_01863
institution arXiv
publishDate 2021
record_format arxiv
spellingShingle DeepEdge: A Deep Reinforcement Learning based Task Orchestrator for Edge Computing
Yamansavascilar, Baris
Baktir, Ahmet Cihat
Sonmez, Cagatay
Ozgovde, Atay
Ersoy, Cem
Networking and Internet Architecture
Distributed, Parallel, and Cluster Computing
Machine Learning
The improvements in the edge computing technology pave the road for diversified applications that demand real-time interaction. However, due to the mobility of the end-users and the dynamic edge environment, it becomes challenging to handle the task offloading with high performance. Moreover, since each application in mobile devices has different characteristics, a task orchestrator must be adaptive and have the ability to learn the dynamics of the environment. For this purpose, we develop a deep reinforcement learning based task orchestrator, DeepEdge, which learns to meet different task requirements without needing human interaction even under the heavily-loaded stochastic network conditions in terms of mobile users and applications. Given the dynamic offloading requests and time-varying communication conditions, we successfully model the problem as a Markov process and then apply the Double Deep Q-Network (DDQN) algorithm to implement DeepEdge. To evaluate the robustness of DeepEdge, we experiment with four different applications including image rendering, infotainment, pervasive health, and augmented reality in the network under various loads. Furthermore, we compare the performance of our agent with the four different task offloading approaches in the literature. Our results show that DeepEdge outperforms its competitors in terms of the percentage of satisfactorily completed tasks.
title DeepEdge: A Deep Reinforcement Learning based Task Orchestrator for Edge Computing
topic Networking and Internet Architecture
Distributed, Parallel, and Cluster Computing
Machine Learning
url https://arxiv.org/abs/2110.01863