Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Li, Zhilin, Pons, Lucia, Petit, Salvador, Sahuquillo, Julio, Pons, Julio
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:https://arxiv.org/abs/2505.03600
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913823172067328
author Li, Zhilin
Pons, Lucia
Petit, Salvador
Sahuquillo, Julio
Pons, Julio
author_facet Li, Zhilin
Pons, Lucia
Petit, Salvador
Sahuquillo, Julio
Pons, Julio
contents Cloud systems have rapidly expanded worldwide in the last decade, shifting computational tasks to cloud servers where clients submit their requests. Among cloud workloads, latency-critical applications -- characterized by high-percentile response times -- have gained special interest. These applications are present in modern services, representing an important fraction of cloud workloads. This work analyzes common cloud benchmarking suites and identifies TailBench as the most suitable to assess cloud performance with latency-critical workloads. Unfortunately, this suite presents key limitations, especially in multi-server scenarios or environments with variable client arrival patterns and fluctuating loads. To address these limitations, we propose TailBench++, an enhanced benchmark suite that extends TailBench to enable cloud evaluation studies to be performed in dynamic multi-client, multi-server environments. It allows reproducing experiments with varying client arrival times, dynamic query per second (QPS) fluctuations, and multiple servers handling requests. Case studies show that TailBench++ enables more realistic evaluations by capturing a wider range of real-world scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2505_03600
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle TailBench++: Flexible Multi-Client, Multi-Server Benchmarking for Latency-Critical Workloads
Li, Zhilin
Pons, Lucia
Petit, Salvador
Sahuquillo, Julio
Pons, Julio
Distributed, Parallel, and Cluster Computing
Cloud systems have rapidly expanded worldwide in the last decade, shifting computational tasks to cloud servers where clients submit their requests. Among cloud workloads, latency-critical applications -- characterized by high-percentile response times -- have gained special interest. These applications are present in modern services, representing an important fraction of cloud workloads. This work analyzes common cloud benchmarking suites and identifies TailBench as the most suitable to assess cloud performance with latency-critical workloads. Unfortunately, this suite presents key limitations, especially in multi-server scenarios or environments with variable client arrival patterns and fluctuating loads. To address these limitations, we propose TailBench++, an enhanced benchmark suite that extends TailBench to enable cloud evaluation studies to be performed in dynamic multi-client, multi-server environments. It allows reproducing experiments with varying client arrival times, dynamic query per second (QPS) fluctuations, and multiple servers handling requests. Case studies show that TailBench++ enables more realistic evaluations by capturing a wider range of real-world scenarios.
title TailBench++: Flexible Multi-Client, Multi-Server Benchmarking for Latency-Critical Workloads
topic Distributed, Parallel, and Cluster Computing
url https://arxiv.org/abs/2505.03600