EdgeRL: Reinforcement Learning-driven Deep Learning Model Inference Optimization at Edge
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866917804724191232 |
|---|---|
| author | Mounesan, Motahare Zhang, Xiaojie Debroy, Saptarshi |
| author_facet | Mounesan, Motahare Zhang, Xiaojie Debroy, Saptarshi |
| contents | Balancing mutually diverging performance metrics, such as, processing latency, outcome accuracy, and end device energy consumption is a challenging undertaking for deep learning model inference in ad-hoc edge environments. In this paper, we propose EdgeRL framework that seeks to strike such balance by using an Advantage Actor-Critic (A2C) Reinforcement Learning (RL) approach that can choose optimal run-time DNN inference parameters and aligns the performance metrics based on the application requirements. Using real world deep learning model and a hardware testbed, we evaluate the benefits of EdgeRL framework in terms of end device energy savings, inference accuracy improvement, and end-to-end inference latency reduction. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_12221 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | EdgeRL: Reinforcement Learning-driven Deep Learning Model Inference Optimization at Edge Mounesan, Motahare Zhang, Xiaojie Debroy, Saptarshi Distributed, Parallel, and Cluster Computing Artificial Intelligence Machine Learning Balancing mutually diverging performance metrics, such as, processing latency, outcome accuracy, and end device energy consumption is a challenging undertaking for deep learning model inference in ad-hoc edge environments. In this paper, we propose EdgeRL framework that seeks to strike such balance by using an Advantage Actor-Critic (A2C) Reinforcement Learning (RL) approach that can choose optimal run-time DNN inference parameters and aligns the performance metrics based on the application requirements. Using real world deep learning model and a hardware testbed, we evaluate the benefits of EdgeRL framework in terms of end device energy savings, inference accuracy improvement, and end-to-end inference latency reduction. |
| title | EdgeRL: Reinforcement Learning-driven Deep Learning Model Inference Optimization at Edge |
| topic | Distributed, Parallel, and Cluster Computing Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2410.12221 |