Cover Image

Gradient-Congruity Guided Federated Sparse Training

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Tian, Chris Xing, Liu, Yibing, Li, Haoliang, Cheung, Ray C. C., Wang, Shiqi
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Neuron Activation Coverage: Rethinking Out-of-distribution Detection and Generalization
by: Liu, Yibing, et al.
Published: (2023)

Unraveling the Mechanics of Learning-Based Demonstration Selection for In-Context Learning
by: Liu, Hui, et al.
Published: (2024)

Spectral Surgery: Training-Free Refinement of LoRA via Gradient-Guided Singular Value Reweighting
by: Tian, Zailong, et al.
Published: (2026)

Training Data Selection with Gradient Orthogonality for Efficient Domain Adaptation
by: Zhang, Xiyang, et al.
Published: (2026)

PFedDST: Personalized Federated Learning with Decentralized Selection Training
by: Fan, Mengchen, et al.
Published: (2025)

SparseBalance: Load-Balanced Long Context Training with Dynamic Sparse Attention
by: Xu, Hongtao, et al.
Published: (2026)

DP-FedPGN: Finding Global Flat Minima for Differentially Private Federated Learning via Penalizing Gradient Norm
by: Liu, Junkang, et al.
Published: (2025)

Generalizing to New Dynamical Systems via Frequency Domain Adaptation
by: Qin, Tiexin, et al.
Published: (2025)

Geminio: Language-Guided Gradient Inversion Attacks in Federated Learning
by: Shan, Junjie, et al.
Published: (2024)

Internal Cross-layer Gradients for Extending Homogeneity to Heterogeneity in Federated Learning
by: Chan, Yun-Hin, et al.
Published: (2023)

FedBCD:Communication-Efficient Accelerated Block Coordinate Gradient Descent for Federated Learning
by: Liu, Junkang, et al.
Published: (2026)

Topology-Aware Revival for Efficient Sparse Training
by: Jin, Meiling, et al.
Published: (2026)

One-shot Federated Learning Methods: A Practical Guide
by: Liu, Xiang, et al.
Published: (2025)

Gradient Inversion Transcript: Leveraging Robust Generative Priors to Reconstruct Training Data from Gradient Leakage
by: Chen, Xinping, et al.
Published: (2025)

GAC: Stabilizing Asynchronous RL Training for LLMs via Gradient Alignment Control
by: Xu, Haofeng, et al.
Published: (2026)

Geometric Prior-Guided Federated Prompt Calibration
by: Luo, Fei, et al.
Published: (2025)

Gradient Inversion in Federated Reinforcement Learning
by: He, Shenghong
Published: (2025)

Training Free Guided Flow Matching with Optimal Control
by: Wang, Luran, et al.
Published: (2024)

Fast Adversarial Training against Sparse Attacks Requires Loss Smoothing
by: Zhong, Xuyang, et al.
Published: (2025)

Taming LLMs by Scaling Learning Rates with Gradient Grouping
by: Li, Siyuan, et al.
Published: (2025)

GaLore 2: Large-Scale LLM Pre-Training by Gradient Low-Rank Projection
by: Su, DiJia, et al.
Published: (2025)

Outlier Gradient Analysis: Efficiently Identifying Detrimental Training Samples for Deep Learning Models
by: Chhabra, Anshuman, et al.
Published: (2024)

Sparse Training for Federated Learning with Regularized Error Correction
by: Greidi, Ran, et al.
Published: (2023)

GradientStabilizer:Fix the Norm, Not the Gradient
by: Huang, Tianjin, et al.
Published: (2025)

FEED: Fairness-Enhanced Meta-Learning for Domain Generalization
by: Jiang, Kai, et al.
Published: (2024)

Decentralized Personalized Federated Learning based on a Conditional Sparse-to-Sparser Scheme
by: Long, Qianyu, et al.
Published: (2024)

DRAGD: A Federated Unlearning Data Reconstruction Attack Based on Gradient Differences
by: Ju, Bocheng, et al.
Published: (2025)

Sub-Scaling Laws: On the Role of Data Density and Training Strategies in LLMs
by: Chen, Zhengyu, et al.
Published: (2025)

GraSS: Scalable Data Attribution with Gradient Sparsification and Sparse Projection
by: Hu, Pingbang, et al.
Published: (2025)

FedConPE: Efficient Federated Conversational Bandits with Heterogeneous Clients
by: Li, Zhuohua, et al.
Published: (2024)

Adaptive Guidance for Local Training in Heterogeneous Federated Learning
by: Zhang, Jianqing, et al.
Published: (2024)

Training-free Ultra Small Model for Universal Sparse Reconstruction in Compressed Sensing
by: Tang, Chaoqing, et al.
Published: (2025)

Uncovering Gradient Inversion Risks in Practical Language Model Training
by: Feng, Xinguo, et al.
Published: (2025)

Gradient-Free Training of Quantized Neural Networks
by: Cohen, Noa, et al.
Published: (2024)

Communication-Efficient Federated Learning with Accelerated Client Gradient
by: Kim, Geeho, et al.
Published: (2022)

Operator-Theoretic Framework for Gradient-Free Federated Learning
by: Kumar, Mohit, et al.
Published: (2025)

A Universal Banach--Bregman Framework for Stochastic Iterations: Unifying Stochastic Mirror Descent, Learning and LLM Training
by: Zhang, Johnny R., et al.
Published: (2025)

Entropy-Gated Selective Policy Optimization:Token-Level Gradient Allocation for Hybrid Training of Large Language Models
by: Hu, Yuelin, et al.
Published: (2026)

Gradient-Informed Temporal Sampling Improves Rollout Accuracy in PDE Surrogate Training
by: Wang, Wenshuo, et al.
Published: (2026)

Provable Sparse Inversion and Token Relabel Enhanced One-shot Federated Learning with ViTs
by: Shen, Li, et al.
Published: (2026)