Cover Image

pFedMoE: Data-Level Personalization with Mixture of Experts for Model-Heterogeneous Personalized Federated Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Yi, Liping, Yu, Han, Ren, Chao, Zhang, Heng, Wang, Gang, Liu, Xiaoguang, Li, Xiaoxiao
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Distributed, Parallel, and Cluster Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

pFedLoRA: Model-Heterogeneous Personalized Federated Learning with LoRA Tuning
by: Yi, Liping, et al.
Published: (2023)

FedSSA: Semantic Similarity-based Aggregation for Efficient Model-Heterogeneous Personalized Federated Learning
by: Yi, Liping, et al.
Published: (2023)

Federated Model Heterogeneous Matryoshka Representation Learning
by: Yi, Liping, et al.
Published: (2024)

Fed-GAME: Personalized Federated Learning with Graph Attention Mixture-of-Experts For Time-Series Forecasting
by: Li, Yi, et al.
Published: (2026)

Hexa-MoE: Efficient and Heterogeneous-aware Training for Mixture-of-Experts
by: Luo, Shuqing, et al.
Published: (2024)

FedMoE-DA: Federated Mixture of Experts via Domain Aware Fine-grained Aggregation
by: Zhan, Ziwei, et al.
Published: (2024)

Personalized Federated Learning on Data with Dynamic Heterogeneity under Limited Storage
by: Tan, Sixing, et al.
Published: (2024)

FedMOA: Federated GRPO for Personalized Reasoning LLMs under Heterogeneous Rewards
by: Wang, Ziyao, et al.
Published: (2026)

FedPeWS: Personalized Warmup via Subnetworks for Enhanced Heterogeneous Federated Learning
by: Tastan, Nurbek, et al.
Published: (2024)

ElasticMoE: An Efficient Auto Scaling Method for Mixture-of-Experts Models
by: Singh, Gursimran, et al.
Published: (2025)

FedCache: A Knowledge Cache-driven Federated Learning Architecture for Personalized Edge Intelligence
by: Wu, Zhiyuan, et al.
Published: (2023)

FedLog: Personalized Federated Classification with Less Communication and More Flexibility
by: Yu, Haolin, et al.
Published: (2024)

HeterMoE: Efficient Training of Mixture-of-Experts Models on Heterogeneous GPUs
by: Wu, Yongji, et al.
Published: (2025)

pMixFed: Efficient Personalized Federated Learning through Adaptive Layer-Wise Mixup
by: Saadati, Yasaman, et al.
Published: (2025)

FedCal: Achieving Local and Global Calibration in Federated Learning via Aggregated Parameterized Scaler
by: Peng, Hongyi, et al.
Published: (2024)

ALANINE: A Novel Decentralized Personalized Federated Learning For Heterogeneous LEO Satellite Constellation
by: Zhao, Liang, et al.
Published: (2024)

FedAH: Aggregated Head for Personalized Federated Learning
by: Zhou, Pengzhan, et al.
Published: (2024)

Hypernetworks for Model-Heterogeneous Personalized Federated Learning
by: Zhang, Chen, et al.
Published: (2025)

FlowMoE: A Scalable Pipeline Scheduling Framework for Distributed Mixture-of-Experts Training
by: Gao, Yunqi, et al.
Published: (2025)

FedReMa: Improving Personalized Federated Learning via Leveraging the Most Relevant Clients
by: Liang, Han, et al.
Published: (2024)

MoE-SpeQ: Speculative Quantized Decoding with Proactive Expert Prefetching and Offloading for Mixture-of-Experts
by: Wang, Wenfeng, et al.
Published: (2025)

A Closer Look at Personalized Fine-Tuning in Heterogeneous Federated Learning
by: Chen, Minghui, et al.
Published: (2025)

pFedLVM: A Large Vision Model (LVM)-Driven and Latent Feature-Based Personalized Federated Learning Framework in Autonomous Driving
by: Kou, Wei-Bin, et al.
Published: (2024)

Fed-REACT: Federated Representation Learning for Heterogeneous and Evolving Data
by: Chen, Yiyue, et al.
Published: (2025)

Stable-MoE: Lyapunov-based Token Routing for Distributed Mixture-of-Experts Training over Edge Networks
by: Shi, Long, et al.
Published: (2025)

EC2MoE: Adaptive End-Cloud Pipeline Collaboration Enabling Scalable Mixture-of-Experts Inference
by: Yang, Zheming, et al.
Published: (2025)

FedPAW: Federated Learning with Personalized Aggregation Weights for Urban Vehicle Speed Prediction
by: He, Yuepeng, et al.
Published: (2024)

DualFed: Enjoying both Generalization and Personalization in Federated Learning via Hierachical Representations
by: Zhu, Guogang, et al.
Published: (2024)

Addressing Skewed Heterogeneity via Federated Prototype Rectification with Personalization
by: Guo, Shunxin, et al.
Published: (2024)

Surviving Partial Rank Failures in Wide Expert-Parallel MoE Inference
by: Sun, Xun, et al.
Published: (2026)

MegaScale-MoE: Large-Scale Communication-Efficient Training of Mixture-of-Experts Models in Production
by: Jin, Chao, et al.
Published: (2025)

FedAPTA: Federated Multi-task Learning for Heterogeneous Devices with Adaptive Layer-wise Pruning and Task-aware Aggregation
by: Yu, Zhen, et al.
Published: (2025)

Elastic Mixture of Rank-Wise Experts for Knowledge Reuse in Federated Fine-Tuning
by: Wu, Yebo, et al.
Published: (2025)

FedSAE: A Novel Self-Adaptive Federated Learning Framework in Heterogeneous Systems
by: Li, Li, et al.
Published: (2021)

Analytic Personalized Federated Meta-Learning
by: Gu, Shunxian, et al.
Published: (2025)

LAER-MoE: Load-Adaptive Expert Re-layout for Efficient Mixture-of-Experts Training
by: Liu, Xinyi, et al.
Published: (2026)

HAP: Hybrid Adaptive Parallelism for Efficient Mixture-of-Experts Inference
by: Lin, Haoran, et al.
Published: (2025)

Janus: Disaggregating Attention and Experts for Scalable MoE Inference
by: Zhang, Zhexiang, et al.
Published: (2025)

OD-MoE: On-Demand Expert Loading for Cacheless Edge-Distributed MoE Inference
by: Wang, Liujianfu, et al.
Published: (2025)

EchoPFL: Asynchronous Personalized Federated Learning on Mobile Devices with On-Demand Staleness Control
by: Li, Xiaochen, et al.
Published: (2024)