Should I Run My Cloud Benchmark on Black Friday?
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866911209318514688 |
|---|---|
| author | Henning, Sören Vogel, Adriano Perez-Wohlfeil, Esteban Ertl, Otmar Rabiser, Rick |
| author_facet | Henning, Sören Vogel, Adriano Perez-Wohlfeil, Esteban Ertl, Otmar Rabiser, Rick |
| contents | Benchmarks and performance experiments are frequently conducted in cloud environments. However, their results are often treated with caution, as the presumed high variability of performance in the cloud raises concerns about reproducibility and credibility. In a recent study, we empirically quantified the impact of this variability on benchmarking results by repeatedly executing a stream processing application benchmark at different times of the day over several months. Our analysis confirms that performance variability is indeed observable at the application level, although it is less pronounced than often assumed. The larger scale of our study compared to related work allowed us to identify subtle daily and weekly performance patterns. We now extend this investigation by examining whether a major global event, such as Black Friday, affects the outcomes of performance benchmarks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_12397 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Should I Run My Cloud Benchmark on Black Friday? Henning, Sören Vogel, Adriano Perez-Wohlfeil, Esteban Ertl, Otmar Rabiser, Rick Software Engineering Distributed, Parallel, and Cluster Computing Performance Benchmarks and performance experiments are frequently conducted in cloud environments. However, their results are often treated with caution, as the presumed high variability of performance in the cloud raises concerns about reproducibility and credibility. In a recent study, we empirically quantified the impact of this variability on benchmarking results by repeatedly executing a stream processing application benchmark at different times of the day over several months. Our analysis confirms that performance variability is indeed observable at the application level, although it is less pronounced than often assumed. The larger scale of our study compared to related work allowed us to identify subtle daily and weekly performance patterns. We now extend this investigation by examining whether a major global event, such as Black Friday, affects the outcomes of performance benchmarks. |
| title | Should I Run My Cloud Benchmark on Black Friday? |
| topic | Software Engineering Distributed, Parallel, and Cluster Computing Performance |
| url | https://arxiv.org/abs/2510.12397 |