DRPC: Distributed Reinforcement Learning Approach for Scalable Resource Provisioning in Container-based Clusters

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Bai, Haoyu, Xu, Minxian, Ye, Kejiang, Buyya, Rajkumar, Xu, Chengzhong
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866916323009757184
author Bai, Haoyu
Xu, Minxian
Ye, Kejiang
Buyya, Rajkumar
Xu, Chengzhong
author_facet Bai, Haoyu
Xu, Minxian
Ye, Kejiang
Buyya, Rajkumar
Xu, Chengzhong
contents Microservices have transformed monolithic applications into lightweight, self-contained, and isolated application components, establishing themselves as a dominant paradigm for application development and deployment in public clouds such as Google and Alibaba. Autoscaling emerges as an efficient strategy for managing resources allocated to microservices' replicas. However, the dynamic and intricate dependencies within microservice chains present challenges to the effective management of scaled microservices. Additionally, the centralized autoscaling approach can encounter scalability issues, especially in the management of large-scale microservice-based clusters. To address these challenges and enhance scalability, we propose an innovative distributed resource provisioning approach for microservices based on the Twin Delayed Deep Deterministic Policy Gradient algorithm. This approach enables effective autoscaling decisions and decentralizes responsibilities from a central node to distributed nodes. Comparative results with state-of-the-art approaches, obtained from a realistic testbed and traces, indicate that our approach reduces the average response time by 15% and the number of failed requests by 24%, validating improved scalability as the number of requests increases.
format Preprint
id arxiv_https___arxiv_org_abs_2407_10169
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle DRPC: Distributed Reinforcement Learning Approach for Scalable Resource Provisioning in Container-based Clusters
Bai, Haoyu
Xu, Minxian
Ye, Kejiang
Buyya, Rajkumar
Xu, Chengzhong
Distributed, Parallel, and Cluster Computing
Microservices have transformed monolithic applications into lightweight, self-contained, and isolated application components, establishing themselves as a dominant paradigm for application development and deployment in public clouds such as Google and Alibaba. Autoscaling emerges as an efficient strategy for managing resources allocated to microservices' replicas. However, the dynamic and intricate dependencies within microservice chains present challenges to the effective management of scaled microservices. Additionally, the centralized autoscaling approach can encounter scalability issues, especially in the management of large-scale microservice-based clusters. To address these challenges and enhance scalability, we propose an innovative distributed resource provisioning approach for microservices based on the Twin Delayed Deep Deterministic Policy Gradient algorithm. This approach enables effective autoscaling decisions and decentralizes responsibilities from a central node to distributed nodes. Comparative results with state-of-the-art approaches, obtained from a realistic testbed and traces, indicate that our approach reduces the average response time by 15% and the number of failed requests by 24%, validating improved scalability as the number of requests increases.
title DRPC: Distributed Reinforcement Learning Approach for Scalable Resource Provisioning in Container-based Clusters
topic Distributed, Parallel, and Cluster Computing
url https://arxiv.org/abs/2407.10169