pPython Performance Study
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2023
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866913182681923584 |
|---|---|
| author | Byun, Chansup Arcand, William Bestor, David Bergeron, Bill Gadepally, Vijay Houle, Michael Hubbell, Matthew Jananthan, Hayden Jones, Michael Klein, Anna Michaleas, Peter Milechin, Lauren Morales, Guillermo Mullen, Julie Prout, Andrew Reuther, Albert Rosa, Antonio Samsi, Siddharth Yee, Charles Kepner, Jeremy |
| author_facet | Byun, Chansup Arcand, William Bestor, David Bergeron, Bill Gadepally, Vijay Houle, Michael Hubbell, Matthew Jananthan, Hayden Jones, Michael Klein, Anna Michaleas, Peter Milechin, Lauren Morales, Guillermo Mullen, Julie Prout, Andrew Reuther, Albert Rosa, Antonio Samsi, Siddharth Yee, Charles Kepner, Jeremy |
| contents | pPython seeks to provide a parallel capability that provides good speed-up without sacrificing the ease of programming in Python by implementing partitioned global array semantics (PGAS) on top of a simple file-based messaging library (PythonMPI) in pure Python. pPython follows a SPMD (single program multiple data) model of computation. pPython runs on a single-node (e.g., a laptop) running Windows, Linux, or MacOS operating systems or on any combination of heterogeneous systems that support Python, including on a cluster through a Slurm scheduler interface so that pPython can be executed in a massively parallel computing environment. It is interesting to see what performance pPython can achieve compared to the traditional socket-based MPI communication because of its unique file-based messaging implementation. In this paper, we present the point-to-point and collective communication performances of pPython and compare them with those obtained by using mpi4py with OpenMPI. For large messages, pPython demonstrates comparable performance as compared to mpi4py. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2309_03931 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | pPython Performance Study Byun, Chansup Arcand, William Bestor, David Bergeron, Bill Gadepally, Vijay Houle, Michael Hubbell, Matthew Jananthan, Hayden Jones, Michael Klein, Anna Michaleas, Peter Milechin, Lauren Morales, Guillermo Mullen, Julie Prout, Andrew Reuther, Albert Rosa, Antonio Samsi, Siddharth Yee, Charles Kepner, Jeremy Distributed, Parallel, and Cluster Computing Performance Programming Languages pPython seeks to provide a parallel capability that provides good speed-up without sacrificing the ease of programming in Python by implementing partitioned global array semantics (PGAS) on top of a simple file-based messaging library (PythonMPI) in pure Python. pPython follows a SPMD (single program multiple data) model of computation. pPython runs on a single-node (e.g., a laptop) running Windows, Linux, or MacOS operating systems or on any combination of heterogeneous systems that support Python, including on a cluster through a Slurm scheduler interface so that pPython can be executed in a massively parallel computing environment. It is interesting to see what performance pPython can achieve compared to the traditional socket-based MPI communication because of its unique file-based messaging implementation. In this paper, we present the point-to-point and collective communication performances of pPython and compare them with those obtained by using mpi4py with OpenMPI. For large messages, pPython demonstrates comparable performance as compared to mpi4py. |
| title | pPython Performance Study |
| topic | Distributed, Parallel, and Cluster Computing Performance Programming Languages |
| url | https://arxiv.org/abs/2309.03931 |