A Decentralized Microservice Scheduling Approach Using Service Mesh in Cloud-Edge Systems

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Wen, Yangyang, Townend, Paul, Östberg, Per-Olov, Souza, Abel, Courageux-Sudan, Clément
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866911207160545280
author Wen, Yangyang
Townend, Paul
Östberg, Per-Olov
Souza, Abel
Courageux-Sudan, Clément
author_facet Wen, Yangyang
Townend, Paul
Östberg, Per-Olov
Souza, Abel
Courageux-Sudan, Clément
contents As microservice-based systems scale across the cloud-edge continuum, traditional centralized scheduling mechanisms increasingly struggle with latency, coordination overhead, and fault tolerance. This paper presents a new architectural direction: leveraging service mesh sidecar proxies as decentralized, in-situ schedulers to enable scalable, low-latency coordination in large-scale, cloud-native environments. We propose embedding lightweight, autonomous scheduling logic into each sidecar, allowing scheduling decisions to be made locally without centralized control. This approach leverages the growing maturity of service mesh infrastructures, which support programmable distributed traffic management. We describe the design of such an architecture and present initial results demonstrating its scalability potential in terms of response time and latency under varying request rates. Rather than delivering a finalized scheduling algorithm, this paper presents a system-level architectural direction and preliminary evidence to support its scalability potential.
format Preprint
id arxiv_https___arxiv_org_abs_2510_11189
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Decentralized Microservice Scheduling Approach Using Service Mesh in Cloud-Edge Systems
Wen, Yangyang
Townend, Paul
Östberg, Per-Olov
Souza, Abel
Courageux-Sudan, Clément
Distributed, Parallel, and Cluster Computing
As microservice-based systems scale across the cloud-edge continuum, traditional centralized scheduling mechanisms increasingly struggle with latency, coordination overhead, and fault tolerance. This paper presents a new architectural direction: leveraging service mesh sidecar proxies as decentralized, in-situ schedulers to enable scalable, low-latency coordination in large-scale, cloud-native environments. We propose embedding lightweight, autonomous scheduling logic into each sidecar, allowing scheduling decisions to be made locally without centralized control. This approach leverages the growing maturity of service mesh infrastructures, which support programmable distributed traffic management. We describe the design of such an architecture and present initial results demonstrating its scalability potential in terms of response time and latency under varying request rates. Rather than delivering a finalized scheduling algorithm, this paper presents a system-level architectural direction and preliminary evidence to support its scalability potential.
title A Decentralized Microservice Scheduling Approach Using Service Mesh in Cloud-Edge Systems
topic Distributed, Parallel, and Cluster Computing
url https://arxiv.org/abs/2510.11189