Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Qaim, Waleed Bin, Ometov, Aleksandr, Campolo, Claudia, Molinaro, Antonella, Lohan, Elena Simona, Nurmi, Jari
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:https://arxiv.org/abs/2510.07487
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866918424280563712
author Qaim, Waleed Bin
Ometov, Aleksandr
Campolo, Claudia
Molinaro, Antonella
Lohan, Elena Simona
Nurmi, Jari
author_facet Qaim, Waleed Bin
Ometov, Aleksandr
Campolo, Claudia
Molinaro, Antonella
Lohan, Elena Simona
Nurmi, Jari
contents Over the years, significant contributions have been made by the research and industrial sectors to improve wearable devices towards the Internet of Wearable Things (IoWT) paradigm. However, wearables are still facing several challenges. Many stem from the limited battery power and insufficient computation resources available on wearable devices. On the other hand, with the popularity of smart wearables, there is a consistent increase in the development of new computationally intensive and latency-critical applications. In such a context, task offloading allows wearables to leverage the resources available on nearby edge devices to enhance the overall user experience. This paper proposes a framework for Reinforcement Learning (RL)-based task offloading in the IoWT. We formulate the task offloading process considering the tradeoff between energy consumption and task accomplishment time. Moreover, we model the task offloading problem as a Markov Decision Process (MDP) and utilize the Q-learning technique to enable the wearable device to make optimal task offloading decisions without prior knowledge. We evaluate the performance of the proposed framework through extensive simulations for various applications and system configurations conducted in the ns-3 network simulator. We also show how varying the main system parameters of the Q-learning algorithm affects the overall performance in terms of average task accomplishment time, average energy consumption, and percentage of tasks offloaded.
format Preprint
id arxiv_https___arxiv_org_abs_2510_07487
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Reinforcement Learning-based Task Offloading in the Internet of Wearable Things
Qaim, Waleed Bin
Ometov, Aleksandr
Campolo, Claudia
Molinaro, Antonella
Lohan, Elena Simona
Nurmi, Jari
Machine Learning
Over the years, significant contributions have been made by the research and industrial sectors to improve wearable devices towards the Internet of Wearable Things (IoWT) paradigm. However, wearables are still facing several challenges. Many stem from the limited battery power and insufficient computation resources available on wearable devices. On the other hand, with the popularity of smart wearables, there is a consistent increase in the development of new computationally intensive and latency-critical applications. In such a context, task offloading allows wearables to leverage the resources available on nearby edge devices to enhance the overall user experience. This paper proposes a framework for Reinforcement Learning (RL)-based task offloading in the IoWT. We formulate the task offloading process considering the tradeoff between energy consumption and task accomplishment time. Moreover, we model the task offloading problem as a Markov Decision Process (MDP) and utilize the Q-learning technique to enable the wearable device to make optimal task offloading decisions without prior knowledge. We evaluate the performance of the proposed framework through extensive simulations for various applications and system configurations conducted in the ns-3 network simulator. We also show how varying the main system parameters of the Q-learning algorithm affects the overall performance in terms of average task accomplishment time, average energy consumption, and percentage of tasks offloaded.
title Reinforcement Learning-based Task Offloading in the Internet of Wearable Things
topic Machine Learning
url https://arxiv.org/abs/2510.07487