A Survey on Foundation Models for Personalized Federated Intelligence

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Qiao, Yu, Le, Huy Q., Raha, Avi Deb, Tran, Phuong-Nam, Adhikary, Apurba, Zhang, Mengchun, Nguyen, Loc X., Huh, Eui-Nam, Niyato, Dusit, Hong, Choong Seon
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917506770272256
author Qiao, Yu
Le, Huy Q.
Raha, Avi Deb
Tran, Phuong-Nam
Adhikary, Apurba
Zhang, Mengchun
Nguyen, Loc X.
Huh, Eui-Nam
Niyato, Dusit
Hong, Choong Seon
author_facet Qiao, Yu
Le, Huy Q.
Raha, Avi Deb
Tran, Phuong-Nam
Adhikary, Apurba
Zhang, Mengchun
Nguyen, Loc X.
Huh, Eui-Nam
Niyato, Dusit
Hong, Choong Seon
contents The rise of large language models (LLMs), such as ChatGPT, Gemini, and Grok, has reshaped the AI landscape. As prominent instances of foundational models (FMs), they exhibit remarkable capabilities in generating human-like content, pushing the boundaries towards artificial general intelligence (AGI). However, their large-scale nature, privacy sensitivity, and substantial computational demands pose significant challenges for personalized customization for end users. To bridge this gap, we present the vision of artificial personalized intelligence (API), which focuses on adapting FMs to individual users while ensuring privacy. As a central enabler of API, we propose personalized federated intelligence (PFI), a new paradigm that not only integrates the privacy benefits of federated learning (FL) with the generalization capabilities of FMs but also places personalization at its core. To this end, we first survey recent advances in FL and FMs that lay the foundation for PFI. We then explore core stages of the PFI pipeline: efficient personalization at the edge, trustworthy adaptation, and adaptive refinement via retrieval-augmented generation. Finally, we highlight future directions for enabling PFI. Overall, this survey aims to lay a foundation for the development of API as a complementary direction to AGI, with PFI as a key enabling paradigm.
format Preprint
id arxiv_https___arxiv_org_abs_2505_06907
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Survey on Foundation Models for Personalized Federated Intelligence
Qiao, Yu
Le, Huy Q.
Raha, Avi Deb
Tran, Phuong-Nam
Adhikary, Apurba
Zhang, Mengchun
Nguyen, Loc X.
Huh, Eui-Nam
Niyato, Dusit
Hong, Choong Seon
Artificial Intelligence
Computer Vision and Pattern Recognition
Neural and Evolutionary Computing
The rise of large language models (LLMs), such as ChatGPT, Gemini, and Grok, has reshaped the AI landscape. As prominent instances of foundational models (FMs), they exhibit remarkable capabilities in generating human-like content, pushing the boundaries towards artificial general intelligence (AGI). However, their large-scale nature, privacy sensitivity, and substantial computational demands pose significant challenges for personalized customization for end users. To bridge this gap, we present the vision of artificial personalized intelligence (API), which focuses on adapting FMs to individual users while ensuring privacy. As a central enabler of API, we propose personalized federated intelligence (PFI), a new paradigm that not only integrates the privacy benefits of federated learning (FL) with the generalization capabilities of FMs but also places personalization at its core. To this end, we first survey recent advances in FL and FMs that lay the foundation for PFI. We then explore core stages of the PFI pipeline: efficient personalization at the edge, trustworthy adaptation, and adaptive refinement via retrieval-augmented generation. Finally, we highlight future directions for enabling PFI. Overall, this survey aims to lay a foundation for the development of API as a complementary direction to AGI, with PFI as a key enabling paradigm.
title A Survey on Foundation Models for Personalized Federated Intelligence
topic Artificial Intelligence
Computer Vision and Pattern Recognition
Neural and Evolutionary Computing
url https://arxiv.org/abs/2505.06907