On Optimal Batch Size in Coded Computing
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866911235774087168 |
|---|---|
| author | Saha, Swapnil Soljanin, Emina Whiting, Philip |
| author_facet | Saha, Swapnil Soljanin, Emina Whiting, Philip |
| contents | We consider computing systems that partition jobs into tasks, add redundancy through coding, and assign the encoded tasks to different computing nodes for parallel execution. The expected execution time depends on the level of redundancy. The computing nodes execute large jobs in batches of tasks. We show that the expected execution time depends on the batch size as well. The optimal batch size that minimizes the execution time depends on the level of redundancy under a fixed number of parallel servers and other system parameters. Furthermore, we show how to (jointly) optimize the redundancy level and batch size to reduce the expected job completion time for two service-time distributions. The simulation presented helps us appreciate the claims. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_06199 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | On Optimal Batch Size in Coded Computing Saha, Swapnil Soljanin, Emina Whiting, Philip Information Theory Distributed, Parallel, and Cluster Computing Performance We consider computing systems that partition jobs into tasks, add redundancy through coding, and assign the encoded tasks to different computing nodes for parallel execution. The expected execution time depends on the level of redundancy. The computing nodes execute large jobs in batches of tasks. We show that the expected execution time depends on the batch size as well. The optimal batch size that minimizes the execution time depends on the level of redundancy under a fixed number of parallel servers and other system parameters. Furthermore, we show how to (jointly) optimize the redundancy level and batch size to reduce the expected job completion time for two service-time distributions. The simulation presented helps us appreciate the claims. |
| title | On Optimal Batch Size in Coded Computing |
| topic | Information Theory Distributed, Parallel, and Cluster Computing Performance |
| url | https://arxiv.org/abs/2505.06199 |