DeLIAP e DeLIAJ: Interfaces de biblioteca de Dependabilidade para Python e Julia
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866909472093372416 |
|---|---|
| author | Irigoyen, Marcos Santana, Carla Araújo, Ramon C. F Xavier-de-Souza, Samuel |
| author_facet | Irigoyen, Marcos Santana, Carla Araújo, Ramon C. F Xavier-de-Souza, Samuel |
| contents | The evergrowing computational complexity of High Performance Computing applications is often met with an horizontal scalling of computing systems. Colaterally, each added node risks being a single point of failure to parallel programs, increasing the demand for fault tolerant techniques to be applied, specially at software level. Under such conditions, the fault tolerance library DeLIA was developed in C/C++ with error detection and recovery features. We propose, then, to extend the library's capabilities to Python and Julia through the wrappers DeLIAP and DeLIAJ in order to lower the barrier to entry for implementing fault-tolerant solutions in these languages, which both lack alternatives to the library. To validate the efficiency of the wrappers, an application of the Julia wrapper in the 4D Full waveform inversion method was analyzed, quantitatively assessing the introduced overhead through runtime comparisons, while an implementation report is provided to address applicability. The added computational cost reflected on a median overhead of 1.4%, while limitations in the original parallel computing module used in the application rendered local-scope data checkpointing unfeasible. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_00703 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | DeLIAP e DeLIAJ: Interfaces de biblioteca de Dependabilidade para Python e Julia Irigoyen, Marcos Santana, Carla Araújo, Ramon C. F Xavier-de-Souza, Samuel Distributed, Parallel, and Cluster Computing The evergrowing computational complexity of High Performance Computing applications is often met with an horizontal scalling of computing systems. Colaterally, each added node risks being a single point of failure to parallel programs, increasing the demand for fault tolerant techniques to be applied, specially at software level. Under such conditions, the fault tolerance library DeLIA was developed in C/C++ with error detection and recovery features. We propose, then, to extend the library's capabilities to Python and Julia through the wrappers DeLIAP and DeLIAJ in order to lower the barrier to entry for implementing fault-tolerant solutions in these languages, which both lack alternatives to the library. To validate the efficiency of the wrappers, an application of the Julia wrapper in the 4D Full waveform inversion method was analyzed, quantitatively assessing the introduced overhead through runtime comparisons, while an implementation report is provided to address applicability. The added computational cost reflected on a median overhead of 1.4%, while limitations in the original parallel computing module used in the application rendered local-scope data checkpointing unfeasible. |
| title | DeLIAP e DeLIAJ: Interfaces de biblioteca de Dependabilidade para Python e Julia |
| topic | Distributed, Parallel, and Cluster Computing |
| url | https://arxiv.org/abs/2502.00703 |