Trillion Parameter AI Serving Infrastructure for Scientific Discovery: A Survey and Vision
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866911771361542144 |
|---|---|
| author | Hudson, Nathaniel Pauloski, J. Gregory Baughman, Matt Kamatar, Alok Sakarvadia, Mansi Ward, Logan Chard, Ryan Bauer, André Levental, Maksim Wang, Wenyi Engler, Will Skelly, Owen Price Blaiszik, Ben Stevens, Rick Chard, Kyle Foster, Ian |
| author_facet | Hudson, Nathaniel Pauloski, J. Gregory Baughman, Matt Kamatar, Alok Sakarvadia, Mansi Ward, Logan Chard, Ryan Bauer, André Levental, Maksim Wang, Wenyi Engler, Will Skelly, Owen Price Blaiszik, Ben Stevens, Rick Chard, Kyle Foster, Ian |
| contents | Deep learning methods are transforming research, enabling new techniques, and ultimately leading to new discoveries. As the demand for more capable AI models continues to grow, we are now entering an era of Trillion Parameter Models (TPM), or models with more than a trillion parameters -- such as Huawei's PanGu-$Σ$. We describe a vision for the ecosystem of TPM users and providers that caters to the specific needs of the scientific community. We then outline the significant technical challenges and open problems in system design for serving TPMs to enable scientific research and discovery. Specifically, we describe the requirements of a comprehensive software stack and interfaces to support the diverse and flexible requirements of researchers. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_03480 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Trillion Parameter AI Serving Infrastructure for Scientific Discovery: A Survey and Vision Hudson, Nathaniel Pauloski, J. Gregory Baughman, Matt Kamatar, Alok Sakarvadia, Mansi Ward, Logan Chard, Ryan Bauer, André Levental, Maksim Wang, Wenyi Engler, Will Skelly, Owen Price Blaiszik, Ben Stevens, Rick Chard, Kyle Foster, Ian Machine Learning Artificial Intelligence Distributed, Parallel, and Cluster Computing Deep learning methods are transforming research, enabling new techniques, and ultimately leading to new discoveries. As the demand for more capable AI models continues to grow, we are now entering an era of Trillion Parameter Models (TPM), or models with more than a trillion parameters -- such as Huawei's PanGu-$Σ$. We describe a vision for the ecosystem of TPM users and providers that caters to the specific needs of the scientific community. We then outline the significant technical challenges and open problems in system design for serving TPMs to enable scientific research and discovery. Specifically, we describe the requirements of a comprehensive software stack and interfaces to support the diverse and flexible requirements of researchers. |
| title | Trillion Parameter AI Serving Infrastructure for Scientific Discovery: A Survey and Vision |
| topic | Machine Learning Artificial Intelligence Distributed, Parallel, and Cluster Computing |
| url | https://arxiv.org/abs/2402.03480 |