Cover Image

DP-FedAdamW: An Efficient Optimizer for Differentially Private Federated Large Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Liu, Jin, Miao, Yinbin, Xi, Ning, Liu, Junkang
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

FedAdamW: A Communication-Efficient Optimizer with Convergence and Generalization Guarantees for Federated Large Models
by: Liu, Junkang, et al.
Published: (2025)

Rethinking LoRA for Privacy-Preserving Federated Learning in Large Models
by: Liu, Jin, et al.
Published: (2026)

DP-FedPGN: Finding Global Flat Minima for Differentially Private Federated Learning via Penalizing Gradient Norm
by: Liu, Junkang, et al.
Published: (2025)

FedMuon: Accelerating Federated Learning with Matrix Orthogonalization
by: Liu, Junkang, et al.
Published: (2025)

FedNSAM:Consistency of Local and Global Flatness for Federated Learning
by: Liu, Junkang, et al.
Published: (2026)

FedBCD:Communication-Efficient Accelerated Block Coordinate Gradient Descent for Federated Learning
by: Liu, Junkang, et al.
Published: (2026)

DP-OPD: Differentially Private On-Policy Distillation for Language Models
by: Khadem, Fatemeh, et al.
Published: (2026)

Taming Preconditioner Drift: Unlocking the Potential of Second-Order Optimizers for Federated Learning on Non-IID Data
by: Liu, Junkang, et al.
Published: (2026)

DP-Fusion: Token-Level Differentially Private Inference for Large Language Models
by: Thareja, Rushil, et al.
Published: (2025)

DP-CSGP: Differentially Private Stochastic Gradient Push with Compressed Communication
by: Zhu, Zehan, et al.
Published: (2025)

DP-DCAN: Differentially Private Deep Contrastive Autoencoder Network for Single-cell Clustering
by: Li, Huifa, et al.
Published: (2023)

FedSDR: Federated Self-Distillation with Rectification
by: Ren, Ziheng, et al.
Published: (2026)

DP-Adam-AC: Privacy-preserving Fine-Tuning of Localizable Language Models Using Adam Optimization with Adaptive Clipping
by: Yang, Ruoxing
Published: (2025)

Too Good to be True? Turn Any Model Differentially Private With DP-Weights
by: Zagardo, David
Published: (2024)

FedZMG: Efficient Client-Side Optimization in Federated Learning
by: Zantalis, Fotios, et al.
Published: (2026)

DP-TabICL: In-Context Learning with Differentially Private Tabular Data
by: Carey, Alycia N., et al.
Published: (2024)

Differentially Private Multimodal Laplacian Dropout (DP-MLD) for EEG Representative Learning
by: Fu, Xiaowen, et al.
Published: (2024)

Navigating LLM Valley: From AdamW to Memory-Efficient and Matrix-Based Optimizers
by: Ranganath, Aditya
Published: (2026)

CEPerFed: Communication-Efficient Personalized Federated Learning for Multi-Pulse MRI Classification
by: Li, Ludi, et al.
Published: (2025)

DP-LAC: Lightweight Adaptive Clipping for Differentially Private Federated Fine-tuning of Language Models
by: Mehmood, Haaris, et al.
Published: (2026)

FedKRSO: Communication and Memory Efficient Federated Fine-Tuning of Large Language Models
by: Yang, Guohao, et al.
Published: (2026)

FedSVD: Adaptive Orthogonalization for Private Federated Learning with LoRA
by: Lee, Seanie, et al.
Published: (2025)

FedSI: Federated Subnetwork Inference for Efficient Uncertainty Quantification
by: Chen, Hui, et al.
Published: (2024)

FedPOB: Sample-Efficient Federated Prompt Optimization via Bandits
by: Lu, Pingchen, et al.
Published: (2025)

FedEAT: A Robustness Optimization Framework for Federated LLMs
by: Pang, Yahao, et al.
Published: (2025)

Statistical Limits and Efficient Algorithms for Differentially Private Federated Learning
by: Auddy, Arnab, et al.
Published: (2026)

FedConPE: Efficient Federated Conversational Bandits with Heterogeneous Clients
by: Li, Zhuohua, et al.
Published: (2024)

Multi-Objective Optimization for Privacy-Utility Balance in Differentially Private Federated Learning
by: Ranaweera, Kanishka, et al.
Published: (2025)

How to set AdamW's weight decay as you scale model and dataset size
by: Wang, Xi, et al.
Published: (2024)

FedFixer: Mitigating Heterogeneous Label Noise in Federated Learning
by: Ji, Xinyuan, et al.
Published: (2024)

Communication-Efficient and Differentially Private Vertical Federated Learning with Zeroth-Order Optimization
by: Zhang, Jianing, et al.
Published: (2025)

Differentially Private Federated Clustering with Random Rebalancing
by: Yang, Xiyuan, et al.
Published: (2025)

APOLLO: SGD-like Memory, AdamW-level Performance
by: Zhu, Hanqing, et al.
Published: (2024)

FedLAP-DP: Federated Learning by Sharing Differentially Private Loss Approximations
by: Wang, Hui-Po, et al.
Published: (2023)

On the Sample Complexity of Differentially Private Policy Optimization
by: He, Yi, et al.
Published: (2025)

FedConv: A Learning-on-Model Paradigm for Heterogeneous Federated Clients
by: Shen, Leming, et al.
Published: (2025)

FedLion: Faster Adaptive Federated Optimization with Fewer Communication
by: Tang, Zhiwei, et al.
Published: (2024)

FedTrans: Efficient Federated Learning via Multi-Model Transformation
by: Zhu, Yuxuan, et al.
Published: (2024)

Optimizer-Induced Mode Connectivity: From AdamW to Muon
by: Zhang, Fangzhao, et al.
Published: (2026)

DP-MemArc: Differential Privacy Transfer Learning for Memory Efficient Language Models
by: Liu, Yanming, et al.
Published: (2024)