The Merit of Simple Policies: Buying Performance With Parallelism and System Architecture

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Yildiz, Mert, Rolich, Alexey, Baiocchi, Andrea
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866908990375460864
author Yildiz, Mert
Rolich, Alexey
Baiocchi, Andrea
author_facet Yildiz, Mert
Rolich, Alexey
Baiocchi, Andrea
contents While scheduling and dispatching of computational workloads is a well-investigated subject, only recently has Google provided publicly a vast high-resolution measurement dataset of its cloud workloads. We revisit dispatching and scheduling algorithms fed by traffic workloads derived from those measurements. The main finding is that mean job response time attains a minimum as the number of servers of the computing cluster is varied, under the constraint that the overall computational budget is kept constant. Moreover, simple policies, such as Join Idle Queue, appear to attain the same performance as more complex, size-based policies for suitably high degrees of parallelism. Further, better performance, definitely outperforming size-based dispatching policies, is obtained by using multi-stage server clusters, even using very simple policies such as Round Robin. The takeaway is that parallelism and architecture of computing systems might be powerful knobs to control performance, even more than policies, under realistic workload traffic.
format Preprint
id arxiv_https___arxiv_org_abs_2503_16166
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle The Merit of Simple Policies: Buying Performance With Parallelism and System Architecture
Yildiz, Mert
Rolich, Alexey
Baiocchi, Andrea
Distributed, Parallel, and Cluster Computing
While scheduling and dispatching of computational workloads is a well-investigated subject, only recently has Google provided publicly a vast high-resolution measurement dataset of its cloud workloads. We revisit dispatching and scheduling algorithms fed by traffic workloads derived from those measurements. The main finding is that mean job response time attains a minimum as the number of servers of the computing cluster is varied, under the constraint that the overall computational budget is kept constant. Moreover, simple policies, such as Join Idle Queue, appear to attain the same performance as more complex, size-based policies for suitably high degrees of parallelism. Further, better performance, definitely outperforming size-based dispatching policies, is obtained by using multi-stage server clusters, even using very simple policies such as Round Robin. The takeaway is that parallelism and architecture of computing systems might be powerful knobs to control performance, even more than policies, under realistic workload traffic.
title The Merit of Simple Policies: Buying Performance With Parallelism and System Architecture
topic Distributed, Parallel, and Cluster Computing
url https://arxiv.org/abs/2503.16166