Smart HPA: A Resource-Efficient Horizontal Pod Auto-scaler for Microservice Architectures

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ahmad, Hussain, Treude, Christoph, Wagner, Markus, Szabo, Claudia
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917735846379520
author Ahmad, Hussain
Treude, Christoph
Wagner, Markus
Szabo, Claudia
author_facet Ahmad, Hussain
Treude, Christoph
Wagner, Markus
Szabo, Claudia
contents Microservice architectures have gained prominence in both academia and industry, offering enhanced agility, reusability, and scalability. To simplify scaling operations in microservice architectures, container orchestration platforms such as Kubernetes feature Horizontal Pod Auto-scalers (HPAs) designed to adjust the resources of microservices to accommodate fluctuating workloads. However, existing HPAs are not suitable for resource-constrained environments, as they make scaling decisions based on the individual resource capacities of microservices, leading to service unavailability and performance degradation. Furthermore, HPA architectures exhibit several issues, including inefficient data processing and a lack of coordinated scaling operations. To address these concerns, we propose Smart HPA, a flexible resource-efficient horizontal pod auto-scaler. It features a hierarchical architecture that integrates both centralized and decentralized architectural styles to leverage their respective strengths while addressing their limitations. We introduce resource-efficient heuristics that empower Smart HPA to exchange resources among microservices, facilitating effective auto-scaling of microservices in resource-constrained environments. Our experimental results show that Smart HPA outperforms the Kubernetes baseline HPA by reducing resource overutilization, overprovisioning, and underprovisioning while increasing resource allocation to microservice applications.
format Preprint
id arxiv_https___arxiv_org_abs_2403_07909
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Smart HPA: A Resource-Efficient Horizontal Pod Auto-scaler for Microservice Architectures
Ahmad, Hussain
Treude, Christoph
Wagner, Markus
Szabo, Claudia
Distributed, Parallel, and Cluster Computing
Systems and Control
Microservice architectures have gained prominence in both academia and industry, offering enhanced agility, reusability, and scalability. To simplify scaling operations in microservice architectures, container orchestration platforms such as Kubernetes feature Horizontal Pod Auto-scalers (HPAs) designed to adjust the resources of microservices to accommodate fluctuating workloads. However, existing HPAs are not suitable for resource-constrained environments, as they make scaling decisions based on the individual resource capacities of microservices, leading to service unavailability and performance degradation. Furthermore, HPA architectures exhibit several issues, including inefficient data processing and a lack of coordinated scaling operations. To address these concerns, we propose Smart HPA, a flexible resource-efficient horizontal pod auto-scaler. It features a hierarchical architecture that integrates both centralized and decentralized architectural styles to leverage their respective strengths while addressing their limitations. We introduce resource-efficient heuristics that empower Smart HPA to exchange resources among microservices, facilitating effective auto-scaling of microservices in resource-constrained environments. Our experimental results show that Smart HPA outperforms the Kubernetes baseline HPA by reducing resource overutilization, overprovisioning, and underprovisioning while increasing resource allocation to microservice applications.
title Smart HPA: A Resource-Efficient Horizontal Pod Auto-scaler for Microservice Architectures
topic Distributed, Parallel, and Cluster Computing
Systems and Control
url https://arxiv.org/abs/2403.07909