Coach: Exploiting Temporal Patterns for All-Resource Oversubscription in Cloud Platforms
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917962749837312 |
|---|---|
| author | Reidys, Benjamin Zardoshti, Pantea Goiri, Íñigo Irvene, Celine Berger, Daniel S. Ma, Haoran Arya, Kapil Cortez, Eli Stark, Taylor Bak, Eugene Iyigun, Mehmet Novaković, Stanko Hsu, Lisa Trueba, Karel Pan, Abhisek Bansal, Chetan Rajmohan, Saravan Huang, Jian Bianchini, Ricardo |
| author_facet | Reidys, Benjamin Zardoshti, Pantea Goiri, Íñigo Irvene, Celine Berger, Daniel S. Ma, Haoran Arya, Kapil Cortez, Eli Stark, Taylor Bak, Eugene Iyigun, Mehmet Novaković, Stanko Hsu, Lisa Trueba, Karel Pan, Abhisek Bansal, Chetan Rajmohan, Saravan Huang, Jian Bianchini, Ricardo |
| contents | Cloud platforms remain underutilized despite multiple proposals to improve their utilization (e.g., disaggregation, harvesting, and oversubscription). Our characterization of the resource utilization of virtual machines (VMs) in Azure reveals that, while CPU is the main underutilized resource, we need to provide a solution to manage all resources holistically. We also observe that many VMs exhibit complementary temporal patterns, which can be leveraged to improve the oversubscription of underutilized resources.
Based on these insights, we propose Coach: a system that exploits temporal patterns for all-resource oversubscription in cloud platforms. Coach uses long-term predictions and an efficient VM scheduling policy to exploit temporally complementary patterns. We introduce a new general-purpose VM type, called CoachVM, where we partition each resource allocation into a guaranteed and an oversubscribed portion. Coach monitors the oversubscribed resources to detect contention and mitigate any potential performance degradation. We focus on memory management, which is particularly challenging due to memory's sensitivity to contention and the overhead required to reassign it between CoachVMs. Our experiments show that Coach enables platforms to host up to ~26% more VMs with minimal performance degradation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_11179 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Coach: Exploiting Temporal Patterns for All-Resource Oversubscription in Cloud Platforms Reidys, Benjamin Zardoshti, Pantea Goiri, Íñigo Irvene, Celine Berger, Daniel S. Ma, Haoran Arya, Kapil Cortez, Eli Stark, Taylor Bak, Eugene Iyigun, Mehmet Novaković, Stanko Hsu, Lisa Trueba, Karel Pan, Abhisek Bansal, Chetan Rajmohan, Saravan Huang, Jian Bianchini, Ricardo Operating Systems Cloud platforms remain underutilized despite multiple proposals to improve their utilization (e.g., disaggregation, harvesting, and oversubscription). Our characterization of the resource utilization of virtual machines (VMs) in Azure reveals that, while CPU is the main underutilized resource, we need to provide a solution to manage all resources holistically. We also observe that many VMs exhibit complementary temporal patterns, which can be leveraged to improve the oversubscription of underutilized resources. Based on these insights, we propose Coach: a system that exploits temporal patterns for all-resource oversubscription in cloud platforms. Coach uses long-term predictions and an efficient VM scheduling policy to exploit temporally complementary patterns. We introduce a new general-purpose VM type, called CoachVM, where we partition each resource allocation into a guaranteed and an oversubscribed portion. Coach monitors the oversubscribed resources to detect contention and mitigate any potential performance degradation. We focus on memory management, which is particularly challenging due to memory's sensitivity to contention and the overhead required to reassign it between CoachVMs. Our experiments show that Coach enables platforms to host up to ~26% more VMs with minimal performance degradation. |
| title | Coach: Exploiting Temporal Patterns for All-Resource Oversubscription in Cloud Platforms |
| topic | Operating Systems |
| url | https://arxiv.org/abs/2501.11179 |