Saved in:
Bibliographic Details
Main Authors: Paganini, Fernando, Goldsztajn, Diego
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2505.03596
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915443007029248
author Paganini, Fernando
Goldsztajn, Diego
author_facet Paganini, Fernando
Goldsztajn, Diego
contents We consider a distributed cloud service deployed at a set of distinct server pools. Arriving jobs are classified into heterogeneous types, in accordance with their setup times which are differentiated at each of the pools. A dispatcher for each job type controls the balance of load between pools, based on decentralized feedback. The system of rates and queues is modeled by a fluid differential equation system, and analyzed via convex optimization. A first, myopic policy is proposed, based on task delay-to-service. Under a simplified dynamic fluid queue model, we prove global convergence to an equilibrium point which minimizes the mean setup time; however queueing delays are incurred with this method. A second proposal is then developed based on proximal optimization, which explicitly models the setup queue and is proved to reach an optimal equilibrium, devoid of queueing delay. Results are demonstrated through a simulation example.
format Preprint
id arxiv_https___arxiv_org_abs_2505_03596
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Dynamic load balancing for cloud systems under heterogeneous setup delays
Paganini, Fernando
Goldsztajn, Diego
Systems and Control
93D05 (Primary) 68M20 (Secondary)
We consider a distributed cloud service deployed at a set of distinct server pools. Arriving jobs are classified into heterogeneous types, in accordance with their setup times which are differentiated at each of the pools. A dispatcher for each job type controls the balance of load between pools, based on decentralized feedback. The system of rates and queues is modeled by a fluid differential equation system, and analyzed via convex optimization. A first, myopic policy is proposed, based on task delay-to-service. Under a simplified dynamic fluid queue model, we prove global convergence to an equilibrium point which minimizes the mean setup time; however queueing delays are incurred with this method. A second proposal is then developed based on proximal optimization, which explicitly models the setup queue and is proved to reach an optimal equilibrium, devoid of queueing delay. Results are demonstrated through a simulation example.
title Dynamic load balancing for cloud systems under heterogeneous setup delays
topic Systems and Control
93D05 (Primary) 68M20 (Secondary)
url https://arxiv.org/abs/2505.03596