Image de couverture de livre

FedAdamW: A Communication-Efficient Optimizer with Convergence and Generalization Guarantees for Federated Large Models

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Liu, Junkang, Shang, Fanhua, Liu, Hongying, Tian, Yuxuan, Liu, Yuanyuan, Liu, Jin, Zhu, Kewen, Lin, Zhouchen
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

DP-FedAdamW: An Efficient Optimizer for Differentially Private Federated Large Models
par: Liu, Jin, et autres
Publié: (2026)

FedNSAM:Consistency of Local and Global Flatness for Federated Learning
par: Liu, Junkang, et autres
Publié: (2026)

FedMuon: Accelerating Federated Learning with Matrix Orthogonalization
par: Liu, Junkang, et autres
Publié: (2025)

FedBCD:Communication-Efficient Accelerated Block Coordinate Gradient Descent for Federated Learning
par: Liu, Junkang, et autres
Publié: (2026)

DP-FedPGN: Finding Global Flat Minima for Differentially Private Federated Learning via Penalizing Gradient Norm
par: Liu, Junkang, et autres
Publié: (2025)

Taming Preconditioner Drift: Unlocking the Potential of Second-Order Optimizers for Federated Learning on Non-IID Data
par: Liu, Junkang, et autres
Publié: (2026)

FedSWA: Improving Generalization in Federated Learning with Highly Heterogeneous Data via Momentum-Based Stochastic Controlled Weight Averaging
par: junkang, Liu, et autres
Publié: (2025)

ILoRA: Federated Learning with Low-Rank Adaptation for Heterogeneous Client Aggregation
par: Zhou, Junchao, et autres
Publié: (2025)

Adam-family Methods for Nonsmooth Optimization with Convergence Guarantees
par: Xiao, Nachuan, et autres
Publié: (2023)

Convergence Rate Analysis of the AdamW-Style Shampoo: Unifying One-Sided and Two-Sided Preconditioning
par: Li, Huan, et autres
Publié: (2026)

On the $O(\frac{\sqrt{d}}{K^{1/4}})$ Convergence Rate of AdamW Measured by $\ell_1$ Norm
par: Li, Huan, et autres
Publié: (2025)

PDD: Manifold-Prior Diverse Distillation for Medical Anomaly Detection
par: Lu, Xijun, et autres
Publié: (2026)

Rethinking LoRA for Privacy-Preserving Federated Learning in Large Models
par: Liu, Jin, et autres
Publié: (2026)

CFCML: A Coarse-to-Fine Crossmodal Learning Framework For Disease Diagnosis Using Multimodal Images and Tabular Data
par: Liu, Tianling, et autres
Publié: (2026)

Completed Feature Disentanglement Learning for Multimodal MRIs Analysis
par: Liu, Tianling, et autres
Publié: (2024)

FedTrans: Efficient Federated Learning via Multi-Model Transformation
par: Zhu, Yuxuan, et autres
Publié: (2024)

CEPerFed: Communication-Efficient Personalized Federated Learning for Multi-Pulse MRI Classification
par: Li, Ludi, et autres
Publié: (2025)

FedPDPO: Federated Personalized Direct Preference Optimization for Large Language Model Alignment
par: Zhu, Kewen, et autres
Publié: (2026)

Simple Convergence Proof of Adam From a Sign-like Descent Perspective
par: Peng, Hanyang, et autres
Publié: (2025)

Communication Efficient Federated Learning with Linear Convergence on Heterogeneous Data
par: Liu, Jie, et autres
Publié: (2025)

Beyond Background Shift: Rethinking Instance Replay in Continual Semantic Segmentation
par: Yin, Hongmei, et autres
Publié: (2025)

Convergence Guarantees for RMSProp and Adam in Generalized-smooth Non-convex Optimization with Affine Noise Variance
par: Zhang, Qi, et autres
Publié: (2024)

On the Convergence of Adam-Type Algorithm for Bilevel Optimization under Unbounded Smoothness
par: Gong, Xiaochuan, et autres
Publié: (2025)

Convergence Rate Analysis of SOAP with Arbitrary Orthogonal Projection Matrices
par: Li, Huan, et autres
Publié: (2026)

FedRLHF: A Convergence-Guaranteed Federated Framework for Privacy-Preserving and Personalized RLHF
par: Fan, Flint Xiaofeng, et autres
Publié: (2024)

FedJudge: Federated Legal Large Language Model
par: Yue, Linan, et autres
Publié: (2023)

Convergence Rate Analysis of LION
par: Dong, Yiming, et autres
Publié: (2024)

FedHFT: Efficient Federated Finetuning with Heterogeneous Edge Clients
par: Ilhan, Fatih, et autres
Publié: (2025)

Fairness-aware Federated Minimax Optimization with Convergence Guarantee
par: Dunda, Gerry Windiarto Mohamad, et autres
Publié: (2023)

E-VRAG: Enhancing Long Video Understanding with Resource-Efficient Retrieval Augmented Generation
par: Xu, Zeyu, et autres
Publié: (2025)

On Convergence of Adam for Stochastic Optimization under Relaxed Assumptions
par: Hong, Yusu, et autres
Publié: (2024)

Fed-pilot: Optimizing LoRA Allocation for Efficient Federated Fine-Tuning with Heterogeneous Clients
par: Zhang, Zikai, et autres
Publié: (2024)

Pose-Guided Fine-Grained Sign Language Video Generation
par: Shi, Tongkai, et autres
Publié: (2024)

Adam Improves Muon: Adaptive Moment Estimation with Orthogonalized Momentum
par: Zhang, Minxin, et autres
Publié: (2026)

FedPOB: Sample-Efficient Federated Prompt Optimization via Bandits
par: Lu, Pingchen, et autres
Publié: (2025)

FedConPE: Efficient Federated Conversational Bandits with Heterogeneous Clients
par: Li, Zhuohua, et autres
Publié: (2024)

FedFMS: Exploring Federated Foundation Models for Medical Image Segmentation
par: Liu, Yuxi, et autres
Publié: (2024)

FedNCV: Optimizing Federated Learning With Networked Control Variates
par: Yaling Liu, et autres
Publié: (2025)

FedSI: Federated Subnetwork Inference for Efficient Uncertainty Quantification
par: Chen, Hui, et autres
Publié: (2024)

Subspace Optimization for Large Language Models with Convergence Guarantees
par: He, Yutong, et autres
Publié: (2024)