Image de couverture de livre

Achieving Linear Speedup with ProxSkip in Distributed Stochastic Optimization

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Guo, Luyao, Alghunaim, Sulaiman A., Yuan, Kun, Condat, Laurent, Cao, Jinde
Format:	Preprint
Publié:	2023
Sujets:	Machine Learning Optimization and Control
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Sparse-ProxSkip: Accelerated Sparse-to-Sparse Training in Federated Learning
par: Meinhardt, Georg, et autres
Publié: (2024)

Diffusion Stochastic Optimization for Min-Max Problems
par: Cai, Haoyuan, et autres
Publié: (2024)

Accelerated Stochastic Min-Max Optimization Based on Bias-corrected Momentum
par: Cai, Haoyuan, et autres
Publié: (2024)

Split, Skip and Play: Variance-Reduced ProxSkip for Tomography Reconstruction is Extremely Fast
par: Papoutsellis, Evangelos, et autres
Publié: (2026)

Convergence Analysis of the PAGE Stochastic Algorithm for Weakly Convex Finite-Sum Optimization
par: Condat, Laurent, et autres
Publié: (2025)

Local adapt-then-combine algorithms for distributed nonsmooth optimization: Achieving provable communication acceleration
par: Guo, Luyao, et autres
Publié: (2026)

Achieving Linear Speedup for Composite Federated Learning
par: Huang, Kun, et autres
Publié: (2026)

A Proximal Gradient Method With Probabilistic Multi-Gossip Communications for Decentralized Composite Optimization
par: Guo, Luyao, et autres
Publié: (2023)

TAMUNA: Doubly Accelerated Distributed Optimization with Local Training, Compression, and Partial Participation
par: Condat, Laurent, et autres
Publié: (2023)

Near-Linear Time Projection onto the $\ell_{1,\infty}$ Ball; Application to Sparse Autoencoders
par: Perez, Guillaume, et autres
Publié: (2023)

BiCoLoR: Communication-Efficient Optimization with Bidirectional Compression and Local Training
par: Condat, Laurent, et autres
Publié: (2026)

LoCoDL: Communication-Efficient Distributed Learning with Local Training and Compression
par: Condat, Laurent, et autres
Publié: (2024)

Optimal Complexity in Byzantine-Robust Distributed Stochastic Optimization with Data Heterogeneity
par: Shi, Qiankun, et autres
Publié: (2025)

Achieving Linear Speedup and Near-Optimal Complexity for Decentralized Optimization over Row-stochastic Networks
par: Liang, Liyuan, et autres
Publié: (2025)

On the Linear Speedup of Personalized Federated Reinforcement Learning with Shared Representations
par: Xiong, Guojun, et autres
Publié: (2024)

The Stochastic Multi-Proximal Method for Nonsmooth Optimization
par: Condat, Laurent, et autres
Publié: (2025)

Low-Rank Mirror-Prox for Nonsmooth and Low-Rank Matrix Optimization Problems
par: Garber, Dan, et autres
Publié: (2022)

DAMA: A Unified Accelerated Approach for Decentralized Nonconvex Minimax Optimization-Part I: Algorithm Development and Results
par: Cai, Haoyuan, et autres
Publié: (2025)

DAMA: A Unified Accelerated Approach for Decentralized Nonconvex Minimax Optimization-Part II: Convergence and Performance Analyses
par: Cai, Haoyuan, et autres
Publié: (2025)

Tighter Performance Theory of FedExProx
par: Anyszka, Wojciech, et autres
Publié: (2024)

A Simple Linear Convergence Analysis of the Point-SAGA Algorithm
par: Condat, Laurent, et autres
Publié: (2024)

Perturbed Proximal Gradient ADMM for Nonconvex Composite Optimization
par: Zhou, Yuan, et autres
Publié: (2025)

On the Linear Speedup of the Push-Pull Method for Decentralized Optimization over Digraphs
par: Liang, Liyuan, et autres
Publié: (2025)

Decentralized Stochastic Constrained Optimization via Prox-Linearization
par: Sharma, Shivangi Dubey, et autres
Publié: (2026)

Robust Out-of-Distribution Stochastic Optimization
par: Li, Xianyu, et autres
Publié: (2026)

From PowerSGD to PowerSGD+: Low-Rank Gradient Compression for Distributed Optimization with Convergence Guarantees
par: Xie, Shengping, et autres
Publié: (2025)

Lions and Muons: Optimization via Stochastic Frank-Wolfe
par: Sfyraki, Maria-Eleni, et autres
Publié: (2025)

Tight Lower Bounds and Optimal Algorithms for Stochastic Nonconvex Optimization with Heavy-Tailed Noise
par: Fradin, Adrien, et autres
Publié: (2025)

Achieving ${O}(ε^{-1.5})$ Complexity in Hessian/Jacobian-free Stochastic Bilevel Optimization
par: Yang, Yifan, et autres
Publié: (2023)

Stochastic Proximal Point Methods for Monotone Inclusions under Expected Similarity
par: Sadiev, Abdurakhmon, et autres
Publié: (2024)

On the Convergence of Stochastic Gradient Descent with Perturbed Forward-Backward Passes
par: Kong, Boao, et autres
Publié: (2026)

Smart Surrogate Losses for Contextual Stochastic Linear Optimization with Robust Constraints
par: Im, Hyungki, et autres
Publié: (2025)

Decision-Dependent Stochastic Optimization: The Role of Distribution Dynamics
par: He, Zhiyu, et autres
Publié: (2025)

Lower Bounds and Accelerated Algorithms in Distributed Stochastic Optimization with Communication Compression
par: He, Yutong, et autres
Publié: (2023)

Stochastic Smoothed Primal-Dual Algorithms for Nonconvex Optimization with Linear Inequality Constraints
par: Huang, Ruichuan, et autres
Publié: (2025)

Quantum Speedups for Markov Chain Monte Carlo Methods with Application to Optimization
par: Ozgul, Guneykan, et autres
Publié: (2025)

Accelerated Optimization Landscape of Linear-Quadratic Regulator
par: Feng, Lechen, et autres
Publié: (2023)

Clapping: Removing Per-sample Storage for Pipeline Parallel Distributed Optimization with Communication Compression
par: Kong, Boao, et autres
Publié: (2025)

Bregman Linearized Augmented Lagrangian Method for Nonconvex Constrained Stochastic Zeroth-order Optimization
par: Shi, Qiankun, et autres
Publié: (2025)

Non-convex Stochastic Composite Optimization with Polyak Momentum
par: Gao, Yuan, et autres
Publié: (2024)