GPU Sharing with Triples Mode
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866910904800509952 |
|---|---|
| author | Byun, Chansup Reuther, Albert Anderson, LaToya Arcand, William Bergeron, Bill Bestor, David Bonn, Alexander Burrill, Daniel Gadepally, Vijay Houle, Michael Hubbell, Matthew Jananthan, Hayden Jones, Michael Luszczek, Piotr Michaleas, Peter Milechin, Lauren Morales, Guillermo Mullen, Julie Prout, Andrew Rosa, Antonio Yee, Charles Kepner, Jeremy |
| author_facet | Byun, Chansup Reuther, Albert Anderson, LaToya Arcand, William Bergeron, Bill Bestor, David Bonn, Alexander Burrill, Daniel Gadepally, Vijay Houle, Michael Hubbell, Matthew Jananthan, Hayden Jones, Michael Luszczek, Piotr Michaleas, Peter Milechin, Lauren Morales, Guillermo Mullen, Julie Prout, Andrew Rosa, Antonio Yee, Charles Kepner, Jeremy |
| contents | There is a tremendous amount of interest in AI/ML technologies due to the proliferation of generative AI applications such as ChatGPT. This trend has significantly increased demand on GPUs, which are the workhorses for training AI models. Due to the high costs of GPUs and lacking supply, it has become of interest to optimize GPU usage in HPC centers. MIT Lincoln Laboratory Supercomputing Center (LLSC) has developed an easy-to-use GPU sharing feature supported by LLSC-developed tools including LLsub and LLMapReduce. This approach overcomes some of the limitations with the existing methods for GPU sharing. This allows users to apply GPU sharing whenever possible while they are developing their AI/ML models and/or doing parametric study on their AI models or executing other GPU applications. Based on our initial experimental results with GPU sharing, GPU sharing with triples mode is easy to use and achieved significant improvement in GPU usage and throughput performance for certain types of AI applications. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_22254 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | GPU Sharing with Triples Mode Byun, Chansup Reuther, Albert Anderson, LaToya Arcand, William Bergeron, Bill Bestor, David Bonn, Alexander Burrill, Daniel Gadepally, Vijay Houle, Michael Hubbell, Matthew Jananthan, Hayden Jones, Michael Luszczek, Piotr Michaleas, Peter Milechin, Lauren Morales, Guillermo Mullen, Julie Prout, Andrew Rosa, Antonio Yee, Charles Kepner, Jeremy Distributed, Parallel, and Cluster Computing There is a tremendous amount of interest in AI/ML technologies due to the proliferation of generative AI applications such as ChatGPT. This trend has significantly increased demand on GPUs, which are the workhorses for training AI models. Due to the high costs of GPUs and lacking supply, it has become of interest to optimize GPU usage in HPC centers. MIT Lincoln Laboratory Supercomputing Center (LLSC) has developed an easy-to-use GPU sharing feature supported by LLSC-developed tools including LLsub and LLMapReduce. This approach overcomes some of the limitations with the existing methods for GPU sharing. This allows users to apply GPU sharing whenever possible while they are developing their AI/ML models and/or doing parametric study on their AI models or executing other GPU applications. Based on our initial experimental results with GPU sharing, GPU sharing with triples mode is easy to use and achieved significant improvement in GPU usage and throughput performance for certain types of AI applications. |
| title | GPU Sharing with Triples Mode |
| topic | Distributed, Parallel, and Cluster Computing |
| url | https://arxiv.org/abs/2410.22254 |