Quantifying the Performance Gap for Simple Versus Optimal Dynamic Server Allocation Policies
Fuente:
arXiv
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912976938729472 |
|---|---|
| author | Carlsson, Niklas Eager, Derek |
| author_facet | Carlsson, Niklas Eager, Derek |
| contents | Cloud computing enables the dynamic provisioning of server resources. To exploit this opportunity, a policy is needed for dynamically allocating (and deallocating) servers in response to the current load conditions. In this paper we describe several simple policies for dynamic server allocation and develop analytic models for their analysis. We also design semi-Markov decision models that enable determination of the performance achieved with optimal policies, allowing us to quantify the performance gap between simple, easily implemented policies, and optimal policies. Finally, we apply our models to study the potential performance benefits of state-dependent routing in multi-site systems when using dynamic server allocation at each site. Insights from our results are valuable to service providers wanting to balance cloud service costs and delays. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_19667 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Quantifying the Performance Gap for Simple Versus Optimal Dynamic Server Allocation Policies Carlsson, Niklas Eager, Derek Distributed, Parallel, and Cluster Computing Networking and Internet Architecture Performance 68M20, 68M01 C.4; C.5.5 Cloud computing enables the dynamic provisioning of server resources. To exploit this opportunity, a policy is needed for dynamically allocating (and deallocating) servers in response to the current load conditions. In this paper we describe several simple policies for dynamic server allocation and develop analytic models for their analysis. We also design semi-Markov decision models that enable determination of the performance achieved with optimal policies, allowing us to quantify the performance gap between simple, easily implemented policies, and optimal policies. Finally, we apply our models to study the potential performance benefits of state-dependent routing in multi-site systems when using dynamic server allocation at each site. Insights from our results are valuable to service providers wanting to balance cloud service costs and delays. |
| title | Quantifying the Performance Gap for Simple Versus Optimal Dynamic Server Allocation Policies |
| topic | Distributed, Parallel, and Cluster Computing Networking and Internet Architecture Performance 68M20, 68M01 C.4; C.5.5 |
| url | https://arxiv.org/abs/2507.19667 |