Saved in:
Bibliographic Details
Main Authors: Boscaro, Maddalena, Mason, Federico, Chiariotti, Federico, Zanella, Andrea
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2411.07086
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916477163012096
author Boscaro, Maddalena
Mason, Federico
Chiariotti, Federico
Zanella, Andrea
author_facet Boscaro, Maddalena
Mason, Federico
Chiariotti, Federico
Zanella, Andrea
contents Artificial Intelligence (AI) is a key component of 6G networks, as it enables communication and computing services to adapt to end users' requirements and demand patterns. The management of Mobile Edge Computing (MEC) is a meaningful example of AI application: computational resources available at the network edge need to be carefully allocated to users, whose jobs may have different priorities and latency requirements. The research community has developed several AI algorithms to perform this resource allocation, but it has neglected a key aspect: learning is itself a computationally demanding task, and considering free training results in idealized conditions and performance in simulations. In this work, we consider a more realistic case in which the cost of learning is specifically accounted for, presenting a new algorithm to dynamically select when to train a Deep Reinforcement Learning (DRL) agent that allocates resources. Our method is highly general, as it can be directly applied to any scenario involving a training overhead, and it can approach the same performance as an ideal learning agent even under realistic training conditions.
format Preprint
id arxiv_https___arxiv_org_abs_2411_07086
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle To Train or Not to Train: Balancing Efficiency and Training Cost in Deep Reinforcement Learning for Mobile Edge Computing
Boscaro, Maddalena
Mason, Federico
Chiariotti, Federico
Zanella, Andrea
Artificial Intelligence
Machine Learning
Systems and Control
Artificial Intelligence (AI) is a key component of 6G networks, as it enables communication and computing services to adapt to end users' requirements and demand patterns. The management of Mobile Edge Computing (MEC) is a meaningful example of AI application: computational resources available at the network edge need to be carefully allocated to users, whose jobs may have different priorities and latency requirements. The research community has developed several AI algorithms to perform this resource allocation, but it has neglected a key aspect: learning is itself a computationally demanding task, and considering free training results in idealized conditions and performance in simulations. In this work, we consider a more realistic case in which the cost of learning is specifically accounted for, presenting a new algorithm to dynamically select when to train a Deep Reinforcement Learning (DRL) agent that allocates resources. Our method is highly general, as it can be directly applied to any scenario involving a training overhead, and it can approach the same performance as an ideal learning agent even under realistic training conditions.
title To Train or Not to Train: Balancing Efficiency and Training Cost in Deep Reinforcement Learning for Mobile Edge Computing
topic Artificial Intelligence
Machine Learning
Systems and Control
url https://arxiv.org/abs/2411.07086