Empowering Federated Learning for Massive Models with NVIDIA FLARE
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866910326961733632 |
|---|---|
| author | Roth, Holger R. Xu, Ziyue Hsieh, Yuan-Ting Renduchintala, Adithya Yang, Isaac Zhang, Zhihong Wen, Yuhong Yang, Sean Lu, Kevin Kersten, Kristopher Ricketts, Camir Xu, Daguang Chen, Chester Cheng, Yan Feng, Andrew |
| author_facet | Roth, Holger R. Xu, Ziyue Hsieh, Yuan-Ting Renduchintala, Adithya Yang, Isaac Zhang, Zhihong Wen, Yuhong Yang, Sean Lu, Kevin Kersten, Kristopher Ricketts, Camir Xu, Daguang Chen, Chester Cheng, Yan Feng, Andrew |
| contents | In the ever-evolving landscape of artificial intelligence (AI) and large language models (LLMs), handling and leveraging data effectively has become a critical challenge. Most state-of-the-art machine learning algorithms are data-centric. However, as the lifeblood of model performance, necessary data cannot always be centralized due to various factors such as privacy, regulation, geopolitics, copyright issues, and the sheer effort required to move vast datasets. In this paper, we explore how federated learning enabled by NVIDIA FLARE can address these challenges with easy and scalable integration capabilities, enabling parameter-efficient and full supervised fine-tuning of LLMs for natural language processing and biopharmaceutical applications to enhance their accuracy and robustness. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_07792 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Empowering Federated Learning for Massive Models with NVIDIA FLARE Roth, Holger R. Xu, Ziyue Hsieh, Yuan-Ting Renduchintala, Adithya Yang, Isaac Zhang, Zhihong Wen, Yuhong Yang, Sean Lu, Kevin Kersten, Kristopher Ricketts, Camir Xu, Daguang Chen, Chester Cheng, Yan Feng, Andrew Machine Learning Distributed, Parallel, and Cluster Computing In the ever-evolving landscape of artificial intelligence (AI) and large language models (LLMs), handling and leveraging data effectively has become a critical challenge. Most state-of-the-art machine learning algorithms are data-centric. However, as the lifeblood of model performance, necessary data cannot always be centralized due to various factors such as privacy, regulation, geopolitics, copyright issues, and the sheer effort required to move vast datasets. In this paper, we explore how federated learning enabled by NVIDIA FLARE can address these challenges with easy and scalable integration capabilities, enabling parameter-efficient and full supervised fine-tuning of LLMs for natural language processing and biopharmaceutical applications to enhance their accuracy and robustness. |
| title | Empowering Federated Learning for Massive Models with NVIDIA FLARE |
| topic | Machine Learning Distributed, Parallel, and Cluster Computing |
| url | https://arxiv.org/abs/2402.07792 |