Shaved Ice: Optimal Compute Resource Commitments for Dynamic Multi-Cloud Workloads
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916714056253440 |
|---|---|
| author | Stokely, Murray Nadgir, Neel Peele, Jack Kostakis, Orestis |
| author_facet | Stokely, Murray Nadgir, Neel Peele, Jack Kostakis, Orestis |
| contents | Cloud providers have introduced pricing models to incentivize long-term commitments of compute capacity. These long-term commitments allow the cloud providers to get guaranteed revenue for their investments in data centers and computing infrastructure. However, these commitments expose cloud customers to demand risk if expected future demand does not materialize. While there are existing studies of theoretical techniques for optimizing performance, latency, and cost, relatively little has been reported so far on the trade-offs between cost savings and demand risk for compute commitments for large-scale cloud services.
We characterize cloud compute demand based on an extensive three year study of the Snowflake Data Cloud, which includes data warehousing, data lakes, data science, data engineering, and other workloads across multiple clouds. We quantify capacity demand drivers from user workloads, hardware generational improvements, and software performance improvements. Using this data, we formulate a series of practical optimizations that maximize capacity availability and minimize costs for the cloud customer. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_10235 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Shaved Ice: Optimal Compute Resource Commitments for Dynamic Multi-Cloud Workloads Stokely, Murray Nadgir, Neel Peele, Jack Kostakis, Orestis Distributed, Parallel, and Cluster Computing C.2.4; K.6.2; C.4 Cloud providers have introduced pricing models to incentivize long-term commitments of compute capacity. These long-term commitments allow the cloud providers to get guaranteed revenue for their investments in data centers and computing infrastructure. However, these commitments expose cloud customers to demand risk if expected future demand does not materialize. While there are existing studies of theoretical techniques for optimizing performance, latency, and cost, relatively little has been reported so far on the trade-offs between cost savings and demand risk for compute commitments for large-scale cloud services. We characterize cloud compute demand based on an extensive three year study of the Snowflake Data Cloud, which includes data warehousing, data lakes, data science, data engineering, and other workloads across multiple clouds. We quantify capacity demand drivers from user workloads, hardware generational improvements, and software performance improvements. Using this data, we formulate a series of practical optimizations that maximize capacity availability and minimize costs for the cloud customer. |
| title | Shaved Ice: Optimal Compute Resource Commitments for Dynamic Multi-Cloud Workloads |
| topic | Distributed, Parallel, and Cluster Computing C.2.4; K.6.2; C.4 |
| url | https://arxiv.org/abs/2503.10235 |