Image de couverture de livre

Faster Adaptive Decentralized Learning Algorithms

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Huang, Feihu, Zhao, Jianyu
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning Optimization and Control
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Optimal Hessian/Jacobian-Free Nonconvex-PL Bilevel Optimization
par: Huang, Feihu
Publié: (2024)

HomeAdam: Adam and AdamW Algorithms Sometimes Go Home to Obtain Better Provable Generalization
par: Huang, Feihu, et autres
Publié: (2026)

Adaptive Federated Minimax Optimization with Lower Complexities
par: Huang, Feihu, et autres
Publié: (2022)

Enhanced Adaptive Gradient Algorithms for Nonconvex-PL Minimax Optimization
par: Huang, Feihu, et autres
Publié: (2023)

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
par: Xie, Xingyu, et autres
Publié: (2022)

Faster Algorithms for Structured Linear and Kernel Support Vector Machines
par: Gu, Yuzhou, et autres
Publié: (2023)

Provably Faster Algorithms for Bilevel Optimization via Without-Replacement Sampling
par: Li, Junyi, et autres
Publié: (2024)

CLion: Efficient Cautious Lion Optimizer with Enhanced Generalization
par: Huang, Feihu, et autres
Publié: (2026)

LiMuon: Light and Fast Muon Optimizer for Large Models
par: Huang, Feihu, et autres
Publié: (2025)

Towards Faster Decentralized Stochastic Optimization with Communication Compression
par: Islamov, Rustem, et autres
Publié: (2024)

Decentralized Contextual Bandits with Network Adaptivity
par: Deng, Chuyun, et autres
Publié: (2025)

Faster Gradient-Free Algorithms for Nonsmooth Nonconvex Stochastic Optimization
par: Chen, Lesi, et autres
Publié: (2023)

Faster Stochastic Algorithms for Minimax Optimization under Polyak--Łojasiewicz Conditions
par: Chen, Lesi, et autres
Publié: (2023)

A Communication-Efficient Decentralized Actor-Critic Algorithm
par: Ren, Xiaoxing, et autres
Publié: (2025)

MiMuon: Mixed Muon Optimizer with Improved Generalization for Large Models
par: Huang, Feihu, et autres
Publié: (2026)

Scalable Decentralized Learning with Teleportation
par: Takezawa, Yuki, et autres
Publié: (2025)

An Efficient Stochastic Algorithm for Decentralized Nonconvex-Strongly-Concave Minimax Optimization
par: Chen, Lesi, et autres
Publié: (2022)

Online Non-convex Optimization with Long-term Non-convex Constraints
par: Pan, Shijie, et autres
Publié: (2023)

A Theoretical and Experimental Study of a Novel Adaptive Learning Algorithm
par: Kumari, Sakshi, et autres
Publié: (2026)

Faster Acceleration for Steepest Descent
par: Bai, Cedar Site, et autres
Publié: (2024)

A Variance-Reduced Stochastic Gradient Tracking Algorithm for Decentralized Optimization with Orthogonality Constraints
par: Wang, Lei, et autres
Publié: (2022)

Stochastic Constrained Decentralized Optimization for Machine Learning with Fewer Data Oracles: a Gradient Sliding Approach
par: Nguyen, Hoang Huy, et autres
Publié: (2024)

Adaptive Moment Estimation Optimization Algorithm Using Projection Gradient for Deep Learning
par: Li, Yongqi, et autres
Publié: (2025)

Faster Algorithms for User-Level Private Stochastic Convex Optimization
par: Lowy, Andrew, et autres
Publié: (2024)

Learning-Augmented Decentralized Online Convex Optimization in Networks
par: Li, Pengfei, et autres
Publié: (2023)

Communication-Efficient Federated Bilevel Optimization with Local and Global Lower Level Problems
par: Li, Junyi, et autres
Publié: (2023)

Lower Bounds and Optimal Algorithms for Non-Smooth Convex Decentralized Optimization over Time-Varying Networks
par: Kovalev, Dmitry, et autres
Publié: (2024)

AdaSwitch: An Adaptive Switching Meta-Algorithm for Learning-Augmented Bounded-Influence Problems
par: Chen, Xi, et autres
Publié: (2025)

Learning Decentralized Linear Quadratic Regulators with $\sqrt{T}$ Regret
par: Ye, Lintao, et autres
Publié: (2022)

The Effectiveness of Local Updates for Decentralized Learning under Data Heterogeneity
par: Wu, Tongle, et autres
Publié: (2024)

RESIST: Resilient Decentralized Learning Using Consensus Gradient Descent
par: Fang, Cheng, et autres
Publié: (2025)

Muon is Provably Faster with Momentum Variance Reduction
par: Qian, Xun, et autres
Publié: (2025)

Faster Fixed-Point Methods for Multichain MDPs
par: Zurek, Matthew, et autres
Publié: (2025)

Drop-Muon: Update Less, Converge Faster
par: Gruntkowska, Kaja, et autres
Publié: (2025)

Learning to Specialize: Joint Gating-Expert Training for Adaptive MoEs in Decentralized Settings
par: Farhat, Yehya, et autres
Publié: (2023)

Adaptive Delayed-Update Cyclic Algorithm for Variational Inequalities
par: Wei, Yi, et autres
Publié: (2026)

Faster Convergence of Local SGD for Over-Parameterized Models
par: Qin, Tiancheng, et autres
Publié: (2022)

Faster Reinforcement Learning by Freezing Slow States
par: Wang, Yijia, et autres
Publié: (2023)

Decentralized Bilevel Optimization: A Perspective from Transient Iteration Complexity
par: Kong, Boao, et autres
Publié: (2024)

Decentralized Riemannian Conjugate Gradient Method on the Stiefel Manifold
par: Chen, Jun, et autres
Publié: (2023)