Saved in:
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2502.21266 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916797305847808 |
|---|---|
| author | Anderlini, Lucio Barbetti, Matteo Bianchini, Giulio Ciangottini, Diego Pra, Stefano Dal Michelotto, Diego Pellegrino, Carmelo Petrini, Rosa Pascolini, Alessandro Spiga, Daniele |
| author_facet | Anderlini, Lucio Barbetti, Matteo Bianchini, Giulio Ciangottini, Diego Pra, Stefano Dal Michelotto, Diego Pellegrino, Carmelo Petrini, Rosa Pascolini, Alessandro Spiga, Daniele |
| contents | Machine Learning (ML) is driving a revolution in the way scientists design, develop, and deploy data-intensive software. However, the adoption of ML presents new challenges for the computing infrastructure, particularly in terms of provisioning and orchestrating access to hardware accelerators for development, testing, and production. The INFN-funded project AI_INFN ("Artificial Intelligence at INFN") aims at fostering the adoption of ML techniques within INFN use cases by providing support on multiple aspects, including the provision of AI-tailored computing resources. It leverages cloud-native solutions in the context of INFN Cloud, to share hardware accelerators as effectively as possible, ensuring the diversity of the Institute's research activities is not compromised. In this contribution, we provide an update on the commissioning of a Kubernetes platform designed to ease the development of GPU-powered data analysis workflows and their scalability on heterogeneous, distributed computing resources, possibly federated as Virtual Kubelets with the interLink provider. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_21266 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Supporting the development of Machine Learning for fundamental science in a federated Cloud with the AI_INFN platform Anderlini, Lucio Barbetti, Matteo Bianchini, Giulio Ciangottini, Diego Pra, Stefano Dal Michelotto, Diego Pellegrino, Carmelo Petrini, Rosa Pascolini, Alessandro Spiga, Daniele Distributed, Parallel, and Cluster Computing Artificial Intelligence Data Analysis, Statistics and Probability Machine Learning (ML) is driving a revolution in the way scientists design, develop, and deploy data-intensive software. However, the adoption of ML presents new challenges for the computing infrastructure, particularly in terms of provisioning and orchestrating access to hardware accelerators for development, testing, and production. The INFN-funded project AI_INFN ("Artificial Intelligence at INFN") aims at fostering the adoption of ML techniques within INFN use cases by providing support on multiple aspects, including the provision of AI-tailored computing resources. It leverages cloud-native solutions in the context of INFN Cloud, to share hardware accelerators as effectively as possible, ensuring the diversity of the Institute's research activities is not compromised. In this contribution, we provide an update on the commissioning of a Kubernetes platform designed to ease the development of GPU-powered data analysis workflows and their scalability on heterogeneous, distributed computing resources, possibly federated as Virtual Kubelets with the interLink provider. |
| title | Supporting the development of Machine Learning for fundamental science in a federated Cloud with the AI_INFN platform |
| topic | Distributed, Parallel, and Cluster Computing Artificial Intelligence Data Analysis, Statistics and Probability |
| url | https://arxiv.org/abs/2502.21266 |