Affordable HPC: Leveraging Small Clusters for Big Data and Graph Computing
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909299220938752 |
|---|---|
| author | Wu, Ruilong Wang, Yisu Kutscher, Dirk |
| author_facet | Wu, Ruilong Wang, Yisu Kutscher, Dirk |
| contents | This study explores strategies for academic researchers to optimize computational resources within limited budgets, focusing on building small, efficient computing clusters. It delves into the comparative costs of purchasing versus renting servers, guided by market research and economic theories on tiered pricing. The paper offers detailed insights into the selection and assembly of hardware components such as CPUs, GPUs, and motherboards tailored to specific research needs. It introduces innovative methods to mitigate the performance issues caused by PCIe switch bandwidth limitations in order to enhance GPU task scheduling. Furthermore, a Graph Neural Network (GNN) framework is proposed to analyze and optimize parallelism in computing networks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_15568 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Affordable HPC: Leveraging Small Clusters for Big Data and Graph Computing Wu, Ruilong Wang, Yisu Kutscher, Dirk Hardware Architecture This study explores strategies for academic researchers to optimize computational resources within limited budgets, focusing on building small, efficient computing clusters. It delves into the comparative costs of purchasing versus renting servers, guided by market research and economic theories on tiered pricing. The paper offers detailed insights into the selection and assembly of hardware components such as CPUs, GPUs, and motherboards tailored to specific research needs. It introduces innovative methods to mitigate the performance issues caused by PCIe switch bandwidth limitations in order to enhance GPU task scheduling. Furthermore, a Graph Neural Network (GNN) framework is proposed to analyze and optimize parallelism in computing networks. |
| title | Affordable HPC: Leveraging Small Clusters for Big Data and Graph Computing |
| topic | Hardware Architecture |
| url | https://arxiv.org/abs/2408.15568 |