Image de couverture de livre

Initialization Matters: Unraveling the Impact of Pre-Training on Federated Learning

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Jhunjhunwala, Divyansh, Sharma, Pranay, Xu, Zheng, Joshi, Gauri
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning Distributed, Parallel, and Cluster Computing
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

FedFisher: Leveraging Fisher Information for One-Shot Federated Learning
par: Jhunjhunwala, Divyansh, et autres
Publié: (2024)

FedAST: Federated Asynchronous Simultaneous Training
par: Askin, Baris, et autres
Publié: (2024)

Debiasing Federated Learning with Correlated Client Participation
par: Sun, Zhenyu, et autres
Publié: (2024)

Federated Communication-Efficient Multi-Objective Optimization
par: Askin, Baris, et autres
Publié: (2024)

FedRPCA: Enhancing Federated LoRA Aggregation Using Robust PCA
par: Jhunjhunwala, Divyansh, et autres
Publié: (2025)

Heterogeneous LoRA for Federated Fine-tuning of On-Device Foundation Models
par: Cho, Yae Jee, et autres
Publié: (2024)

Photon: Federated LLM Pre-Training
par: Sani, Lorenzo, et autres
Publié: (2024)

Vertical Federated Learning Hybrid Local Pre-training
par: Li, Wenguo, et autres
Publié: (2024)

Breaking the Memory Wall for Heterogeneous Federated Learning via Progressive Training
par: Wu, Yebo, et autres
Publié: (2024)

FLMarket: Enabling Privacy-preserved Pre-training Data Pricing for Federated Learning
par: Wen, Zhenyu, et autres
Publié: (2024)

GPT-FL: Generative Pre-trained Model-Assisted Federated Learning
par: Zhang, Tuo, et autres
Publié: (2023)

FL-PBM: Pre-Training Backdoor Mitigation for Federated Learning
par: Wehbi, Osama, et autres
Publié: (2026)

The Impact of Cut Layer Selection in Split Federated Learning
par: Dachille, Justin, et autres
Publié: (2024)

Decoupled Vertical Federated Learning for Practical Training on Vertically Partitioned Data
par: Amalanshu, Avi, et autres
Publié: (2024)

A Robust Federated Learning Framework for Undependable Devices at Scale
par: Wang, Shilong, et autres
Publié: (2024)

Revisiting Ensembling in One-Shot Federated Learning
par: Allouah, Youssef, et autres
Publié: (2024)

Towards Federated Learning with On-device Training and Communication in 8-bit Floating Point
par: Wang, Bokun, et autres
Publié: (2024)

FedQueue: Queue-Aware Federated Learning for Cross-Facility HPC Training
par: Li, Yijiang, et autres
Publié: (2026)

Non-Federated Multi-Task Split Learning for Heterogeneous Sources
par: Zheng, Yilin, et autres
Publié: (2024)

Boosting Resource-Constrained Federated Learning Systems with Guessed Updates
par: Boukhari, Mohamed Yassine, et autres
Publié: (2021)

Embracing Federated Learning: Enabling Weak Client Participation via Partial Model Training
par: Lee, Sunwoo, et autres
Publié: (2024)

Adaptive Federated Learning via New Entropy Approach
par: Zheng, Shensheng, et autres
Publié: (2023)

LLM Inference at the Edge: Mobile, NPU, and GPU Performance Efficiency Trade-offs Under Sustained Load
par: Tummalapalli, Pranay, et autres
Publié: (2026)

Agglomerative Federated Learning: Empowering Larger Model Training via End-Edge-Cloud Collaboration
par: Wu, Zhiyuan, et autres
Publié: (2023)

Dual-Distilled Heterogeneous Federated Learning with Adaptive Margins for Trainable Global Prototypes
par: Siddika, Fatema, et autres
Publié: (2025)

Review of Mathematical Optimization in Federated Learning
par: Yang, Shusen, et autres
Publié: (2024)

Federated Learning in the Presence of Adversarial Client Unavailability
par: Su, Lili, et autres
Publié: (2023)

Energy-Aware Decentralized Learning with Intermittent Model Training
par: Dhasade, Akash, et autres
Publié: (2024)

An Efficient Subspace Algorithm for Federated Learning on Heterogeneous Data
par: Zhang, Jiaojiao, et autres
Publié: (2025)

STHFL: Spatio-Temporal Heterogeneous Federated Learning
par: Guo, Shunxin, et autres
Publié: (2025)

Tackling Privacy Heterogeneity in Differentially Private Federated Learning
par: Xu, Ruichen, et autres
Publié: (2026)

Ranking-based Client Selection with Imitation Learning for Efficient Federated Learning
par: Tian, Chunlin, et autres
Publié: (2024)

A Semi-Supervised Federated Learning Framework with Hierarchical Clustering Aggregation for Heterogeneous Satellite Networks
par: Liu, Zhuocheng, et autres
Publié: (2025)

Prioritizing Modalities: Flexible Importance Scheduling in Federated Multimodal Learning
par: Bian, Jieming, et autres
Publié: (2024)

SemiSFL: Split Federated Learning on Unlabeled and Non-IID Data
par: Xu, Yang, et autres
Publié: (2023)

FedOBD: Opportunistic Block Dropout for Efficiently Training Large-scale Neural Networks through Federated Learning
par: Chen, Yuanyuan, et autres
Publié: (2022)

AMSFL: Adaptive Multi-Step Federated Learning via Gradient Difference-Based Error Modeling
par: Xu, Ganglou
Publié: (2025)

LoGoFair: Post-Processing for Local and Global Fairness in Federated Learning
par: Zhang, Li, et autres
Publié: (2025)

AIGC-assisted Federated Learning for Edge Intelligence: Architecture Design, Research Challenges and Future Directions
par: Qiang, Xianke, et autres
Publié: (2025)

Accelerating Hybrid Federated Learning Convergence under Partial Participation
par: Bian, Jieming, et autres
Publié: (2023)