Copertina

Elastic Multi-Gradient Descent for Parallel Continual Learning

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Lyu, Fan, Feng, Wei, Li, Yuepan, Sun, Qing, Shang, Fanhua, Wan, Liang, Wang, Liang
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Towards stable training of parallel continual learning
di: Yuepan, Li, et al.
Pubblicazione: (2024)

FedBCD:Communication-Efficient Accelerated Block Coordinate Gradient Descent for Federated Learning
di: Liu, Junkang, et al.
Pubblicazione: (2026)

Bypassing the Exponential Dependency: Looped Transformers Efficiently Learn In-context by Multi-step Gradient Descent
di: Chen, Bo, et al.
Pubblicazione: (2024)

Turning Stale Gradients into Stable Gradients: Coherent Coordinate Descent with Implicit Landscape Smoothing for Lightweight Zeroth-Order Optimization
di: Liang, Chen, et al.
Pubblicazione: (2026)

Gradient Descent Algorithm Survey
di: Fucheng, Deng, et al.
Pubblicazione: (2025)

Fisher-Orthogonal Projected Natural Gradient Descent for Continual Learning
di: Garg, Ishir, et al.
Pubblicazione: (2026)

DP-FedPGN: Finding Global Flat Minima for Differentially Private Federated Learning via Penalizing Gradient Norm
di: Liu, Junkang, et al.
Pubblicazione: (2025)

Conflict-Averse Gradient Descent for Multi-task Learning
di: Liu, Bo, et al.
Pubblicazione: (2021)

Transformers Learn to Implement Multi-step Gradient Descent with Chain of Thought
di: Huang, Jianhao, et al.
Pubblicazione: (2025)

FedNSAM:Consistency of Local and Global Flatness for Federated Learning
di: Liu, Junkang, et al.
Pubblicazione: (2026)

Multi-head Transformers Provably Learn Symbolic Multi-step Reasoning via Gradient Descent
di: Yang, Tong, et al.
Pubblicazione: (2025)

Learning Associative Memories with Gradient Descent
di: Cabannes, Vivien, et al.
Pubblicazione: (2024)

Natural Gradient Descent for Online Continual Learning
di: Khawand, Joe, et al.
Pubblicazione: (2026)

Overcoming Domain Drift in Online Continual Learning
di: Lyu, Fan, et al.
Pubblicazione: (2024)

Dynamic Universal Approximation Theory: Foundations for Parallelism in Neural Networks
di: Wang, Wei, et al.
Pubblicazione: (2024)

Can Looped Transformers Learn to Implement Multi-step Gradient Descent for In-context Learning?
di: Gatmiry, Khashayar, et al.
Pubblicazione: (2024)

Taming Preconditioner Drift: Unlocking the Potential of Second-Order Optimizers for Federated Learning on Non-IID Data
di: Liu, Junkang, et al.
Pubblicazione: (2026)

FedMuon: Accelerating Federated Learning with Matrix Orthogonalization
di: Liu, Junkang, et al.
Pubblicazione: (2025)

Damba-ST: Domain-Adaptive Mamba for Efficient Urban Spatio-Temporal Prediction
di: An, Rui, et al.
Pubblicazione: (2025)

Randomness and Interpolation Improve Gradient Descent
di: Li, Jiawen, et al.
Pubblicazione: (2025)

Enhancing Deep Learning with Optimized Gradient Descent: Bridging Numerical Methods and Neural Network Training
di: Ma, Yuhan, et al.
Pubblicazione: (2024)

The Initialization Determines Whether In-Context Learning Is Gradient Descent
di: Xie, Shifeng, et al.
Pubblicazione: (2025)

PSMGD: Periodic Stochastic Multi-Gradient Descent for Fast Multi-Objective Optimization
di: Xu, Mingjing, et al.
Pubblicazione: (2024)

Less is More: Pseudo-Label Filtering for Continual Test-Time Adaptation
di: Tan, Jiayao, et al.
Pubblicazione: (2024)

Stochastic Gradient Descent with Momentum is Algorithmically Stable
di: Lei, Yunwen, et al.
Pubblicazione: (2026)

GreenTEA: Gradient Descent with Topic-modeling and Evolutionary Auto-prompting
di: Dong, Zheng, et al.
Pubblicazione: (2025)

Adaptive Budget Allocation for Orthogonal-Subspace Adapter Tuning in LLMs Continual Learning
di: Wan, Zhiyi, et al.
Pubblicazione: (2025)

Descent-Guided Policy Gradient for Scalable Cooperative Multi-Agent Learning
di: Yang, Shan, et al.
Pubblicazione: (2026)

A Survey of Continual Reinforcement Learning
di: Pan, Chaofan, et al.
Pubblicazione: (2025)

Noise Balance and Stationary Distribution of Stochastic Gradient Descent
di: Ziyin, Liu, et al.
Pubblicazione: (2023)

ONG: Orthogonal Natural Gradient Descent
di: Yadav, Yajat, et al.
Pubblicazione: (2025)

FedSWA: Improving Generalization in Federated Learning with Highly Heterogeneous Data via Momentum-Based Stochastic Controlled Weight Averaging
di: junkang, Liu, et al.
Pubblicazione: (2025)

Differentially Private Two-Stage Gradient Descent for Instrumental Variable Regression
di: Liang, Haodong, et al.
Pubblicazione: (2025)

Geodesic Gradient Descent: A Generic and Learning-rate-free Optimizer on Objective Function-induced Manifolds
di: Hu, Liwei, et al.
Pubblicazione: (2026)

Controllable Continual Test-Time Adaptation
di: Shi, Ziqi, et al.
Pubblicazione: (2024)

GCFL: A Gradient Correction-based Federated Learning Framework for Privacy-preserving CPSS
di: Wan, Jiayi, et al.
Pubblicazione: (2025)

Geometrically Inspired Kernel Machines for Collaborative Learning Beyond Gradient Descent
di: Kumar, Mohit, et al.
Pubblicazione: (2024)

GradTree: Learning Axis-Aligned Decision Trees with Gradient Descent
di: Marton, Sascha, et al.
Pubblicazione: (2023)

Multi-granularity Knowledge Transfer for Continual Reinforcement Learning
di: Pan, Chaofan, et al.
Pubblicazione: (2024)

Cooperative Edge Caching Based on Elastic Federated and Multi-Agent Deep Reinforcement Learning in Next-Generation Network
di: Wu, Qiong, et al.
Pubblicazione: (2024)