DMRlib: Easy-coding and Efficient Resource Management for Job Malleability
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866909000764751872 |
|---|---|
| author | Iserte, Sergio Mayo, Rafael Quintana-Ortí, Enrique S. Peña, Antonio J. |
| author_facet | Iserte, Sergio Mayo, Rafael Quintana-Ortí, Enrique S. Peña, Antonio J. |
| contents | Process malleability has proved to have a highly positive impact on the resource utilization and global productivity in data centers compared with the conventional static resource allocation policy. However, the non-negligible additional development effort this solution imposes has constrained its adoption by the scientific programming community. In this work, we present DMRlib, a library designed to offer the global advantages of process malleability while providing a minimalist MPI-like syntax. The library includes a series of predefined communication patterns that greatly ease the development of malleable applications. In addition, we deploy several scenarios to demonstrate the positive impact of process malleability featuring different scalability patterns. Concretely, we study two job submission modes (rigid and moldable) in order to identify the best-case scenarios for malleability using metrics such as resource allocation rate, completed jobs per second, and energy consumption. The experiments prove that our elastic approach may improve global throughput by a factor higher than 3x compared to the traditional workloads of non-malleable jobs. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_26624 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | DMRlib: Easy-coding and Efficient Resource Management for Job Malleability Iserte, Sergio Mayo, Rafael Quintana-Ortí, Enrique S. Peña, Antonio J. Distributed, Parallel, and Cluster Computing Process malleability has proved to have a highly positive impact on the resource utilization and global productivity in data centers compared with the conventional static resource allocation policy. However, the non-negligible additional development effort this solution imposes has constrained its adoption by the scientific programming community. In this work, we present DMRlib, a library designed to offer the global advantages of process malleability while providing a minimalist MPI-like syntax. The library includes a series of predefined communication patterns that greatly ease the development of malleable applications. In addition, we deploy several scenarios to demonstrate the positive impact of process malleability featuring different scalability patterns. Concretely, we study two job submission modes (rigid and moldable) in order to identify the best-case scenarios for malleability using metrics such as resource allocation rate, completed jobs per second, and energy consumption. The experiments prove that our elastic approach may improve global throughput by a factor higher than 3x compared to the traditional workloads of non-malleable jobs. |
| title | DMRlib: Easy-coding and Efficient Resource Management for Job Malleability |
| topic | Distributed, Parallel, and Cluster Computing |
| url | https://arxiv.org/abs/2604.26624 |