Image de couverture de livre

Save It All: Enabling Full Parameter Tuning for Federated Large Language Models via Cycle Block Gradient Descent

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Wang, Lin, Wang, Zhichao, Tang, Xiaoying
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Federated Unlearning with Gradient Descent and Conflict Mitigation
par: Pan, Zibin, et autres
Publié: (2024)

Ferret: Federated Full-Parameter Tuning at Scale for Large Language Models
par: Shu, Yao, et autres
Publié: (2024)

Entropy-driven Fair and Effective Federated Learning
par: Wang, Lin, et autres
Publié: (2023)

Attacking Large Language Models with Projected Gradient Descent
par: Geisler, Simon, et autres
Publié: (2024)

Automated Federated Pipeline for Parameter-Efficient Fine-Tuning of Large Language Models
par: Fang, Zihan, et autres
Publié: (2024)

FedMABA: Towards Fair Federated Learning through Multi-Armed Bandits Allocation
par: Wang, Zhichao, et autres
Publié: (2024)

Dynamic Scaled Gradient Descent for Stable Fine-Tuning for Classifications
par: Bui, Nghia, et autres
Publié: (2026)

Break the Block: Dynamic-size Reasoning Blocks for Diffusion Large Language Models via Monotonic Entropy Descent with Reinforcement Learning
par: Jiang, Yan, et autres
Publié: (2026)

Parameter Symmetry and Noise Equilibrium of Stochastic Gradient Descent
par: Ziyin, Liu, et autres
Publié: (2024)

RevFFN: Memory-Efficient Full-Parameter Fine-Tuning of Mixture-of-Experts LLMs with Reversible Blocks
par: Liu, Ningyuan, et autres
Publié: (2025)

FedBCD:Communication-Efficient Accelerated Block Coordinate Gradient Descent for Federated Learning
par: Liu, Junkang, et autres
Publié: (2026)

Client2Vec: Improving Federated Learning by Distribution Shifts Aware Client Indexing
par: Guo, Yongxin, et autres
Publié: (2024)

Exploring Parameter-Efficient Fine-Tuning to Enable Foundation Models in Federated Learning
par: Sun, Guangyu, et autres
Publié: (2022)

Gradient Descent with Provably Tuned Learning-rate Schedules
par: Sharma, Dravyansh
Publié: (2025)

Federated Full-Parameter Tuning of Billion-Sized Language Models with Communication Cost under 18 Kilobytes
par: Qin, Zhen, et autres
Publié: (2023)

Smart Sampling: Helping from Friendly Neighbors for Decentralized Federated Learning
par: Wang, Lin, et autres
Publié: (2024)

Is All Learning (Natural) Gradient Descent?
par: Shoji, Lucas, et autres
Publié: (2024)

Minimax Optimal Convergence of Gradient Descent in Logistic Regression via Large and Adaptive Stepsizes
par: Zhang, Ruiqi, et autres
Publié: (2025)

Beyond Cross-Validation: Adaptive Parameter Selection for Kernel-Based Gradient Descents
par: Liu, Xiaotong, et autres
Publié: (2026)

Universal and Transferable Adversarial Attack on Large Language Models Using Exponentiated Gradient Descent
par: Biswas, Sajib, et autres
Publié: (2025)

Personalized Federated Learning with Exact Stochastic Gradient Descent
par: Nikoloutsopoulos, Sotirios, et autres
Publié: (2022)

ParaBlock: Communication-Computation Parallel Block Coordinate Federated Learning for Large Language Models
par: Wang, Yujia, et autres
Publié: (2025)

Enhancing Clustered Federated Learning: Integration of Strategies and Improved Methodologies
par: Guo, Yongxin, et autres
Publié: (2023)

Low-Tubal-Rank Tensor Recovery via Factorized Gradient Descent
par: Liu, Zhiyu, et autres
Publié: (2024)

Gradient Descent Algorithm Survey
par: Fucheng, Deng, et autres
Publié: (2025)

Gradient Descent with Polyak's Momentum Finds Flatter Minima via Large Catapults
par: Phunyaphibarn, Prin, et autres
Publié: (2023)

Sparse Gradient Compression for Fine-Tuning Large Language Models
par: Yang, David H., et autres
Publié: (2025)

Parameter-free Clipped Gradient Descent Meets Polyak
par: Takezawa, Yuki, et autres
Publié: (2024)

FedRC: Tackling Diverse Distribution Shifts Challenge in Federated Learning by Robust Clustering
par: Guo, Yongxin, et autres
Publié: (2023)

Adversarial Attack on Large Language Models using Exponentiated Gradient Descent
par: Biswas, Sajib, et autres
Publié: (2025)

Generalization Guarantees on Data-Driven Tuning of Gradient Descent with Langevin Updates
par: Goyal, Saumya, et autres
Publié: (2026)

Efficient Over-parameterized Matrix Sensing from Noisy Measurements via Alternating Preconditioned Gradient Descent
par: Liu, Zhiyu, et autres
Publié: (2025)

Transfer Learning in Physics-Informed Neural Networks: Full Fine-Tuning, Lightweight Fine-Tuning, and Low-Rank Adaptation
par: Wang, Yizheng, et autres
Publié: (2025)

Efficient Low-Tubal-Rank Tensor Estimation via Alternating Preconditioned Gradient Descent
par: Liu, Zhiyu, et autres
Publié: (2025)

Modeling Multi-Task Model Merging as Adaptive Projective Gradient Descent
par: Wei, Yongxian, et autres
Publié: (2025)

Block Circulant Adapter for Large Language Models
par: Ding, Xinyu, et autres
Publié: (2025)

Comparing Federated Stochastic Gradient Descent and Federated Averaging for Predicting Hospital Length of Stay
par: Balik, Mehmet Yigit
Publié: (2024)

LoRA-One: One-Step Full Gradient Could Suffice for Fine-Tuning Large Language Models, Provably and Efficiently
par: Zhang, Yuanhe, et autres
Publié: (2025)

FedCCRL: Federated Domain Generalization with Cross-Client Representation Learning
par: Wang, Xinpeng, et autres
Publié: (2024)

$\nabla$-Reasoner: LLM Reasoning via Test-Time Gradient Descent in Latent Space
par: Wang, Peihao, et autres
Publié: (2026)