Image de couverture de livre

TAMUNA: Doubly Accelerated Distributed Optimization with Local Training, Compression, and Partial Participation

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Condat, Laurent, Agarský, Ivan, Malinovsky, Grigory, Richtárik, Peter
Format:	Preprint
Publié:	2023
Sujets:	Machine Learning Optimization and Control
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

CompressedScaffnew: The First Theoretical Double Acceleration of Communication from Local Training and Compression in Distributed Optimization
par: Condat, Laurent, et autres
Publié: (2022)

BiCoLoR: Communication-Efficient Optimization with Bidirectional Compression and Local Training
par: Condat, Laurent, et autres
Publié: (2026)

LoCoDL: Communication-Efficient Distributed Learning with Local Training and Compression
par: Condat, Laurent, et autres
Publié: (2024)

Convergence Analysis of the PAGE Stochastic Algorithm for Weakly Convex Finite-Sum Optimization
par: Condat, Laurent, et autres
Publié: (2025)

Sparse-ProxSkip: Accelerated Sparse-to-Sparse Training in Federated Learning
par: Meinhardt, Georg, et autres
Publié: (2024)

Revisiting Stochastic Proximal Point Methods: Generalized Smoothness and Similarity
par: Tovmasyan, Zhirayr, et autres
Publié: (2025)

Byzantine Robustness and Partial Participation Can Be Achieved at Once: Just Clip Gradient Differences
par: Malinovsky, Grigory, et autres
Publié: (2023)

First Provable Guarantees for Practical Private FL: Beyond Restrictive Assumptions
par: Shulgin, Egor, et autres
Publié: (2025)

Methods with Local Steps and Random Reshuffling for Generally Smooth Non-Convex Federated Optimization
par: Demidovich, Yury, et autres
Publié: (2024)

A Computation and Communication Efficient Method for Distributed Nonconvex Problems in the Partial Participation Setting
par: Tyurin, Alexander, et autres
Publié: (2022)

MAST: Model-Agnostic Sparsified Training
par: Demidovich, Yury, et autres
Publié: (2023)

A Nesterov-Accelerated Primal-Dual Splitting Algorithm for Convex Nonsmooth Optimization
par: Condat, Laurent, et autres
Publié: (2026)

Byzantine-Robust and Differentially Private Federated Optimization under Weaker Assumptions
par: Islamov, Rustem, et autres
Publié: (2026)

Improved Convergence in Parameter-Agnostic Error Feedback through Momentum
par: Sadiev, Abdurakhmon, et autres
Publié: (2025)

A Simple Linear Convergence Analysis of the Point-SAGA Algorithm
par: Condat, Laurent, et autres
Publié: (2024)

A Unified Primal-Dual Recipe for Accelerating Three-Operator Splitting Methods
par: Sadiev, Abdurakhmon, et autres
Publié: (2026)

The Stochastic Multi-Proximal Method for Nonsmooth Optimization
par: Condat, Laurent, et autres
Publié: (2025)

Achieving Linear Speedup with ProxSkip in Distributed Stochastic Optimization
par: Guo, Luyao, et autres
Publié: (2023)

Randomized Asymmetric Chain of LoRA: The First Meaningful Theoretical Framework for Low-Rank Adaptation
par: Malinovsky, Grigory, et autres
Publié: (2024)

Stochastic Proximal Point Methods for Monotone Inclusions under Expected Similarity
par: Sadiev, Abdurakhmon, et autres
Publié: (2024)

Local LMO: Constrained Gradient Optimization via a Local Linear Minimization Oracle
par: Richtárik, Peter, et autres
Publié: (2026)

Tight Lower Bounds and Optimal Algorithms for Stochastic Nonconvex Optimization with Heavy-Tailed Noise
par: Fradin, Adrien, et autres
Publié: (2025)

Near-Linear Time Projection onto the $\ell_{1,\infty}$ Ball; Application to Sparse Autoencoders
par: Perez, Guillaume, et autres
Publié: (2023)

Improving the Worst-Case Bidirectional Communication Complexity for Nonconvex Distributed Optimization under Function Similarity
par: Gruntkowska, Kaja, et autres
Publié: (2024)

Non-Euclidean Broximal Point Method: A Blueprint for Geometry-Aware Optimization
par: Gruntkowska, Kaja, et autres
Publié: (2025)

MARINA-P: Superior Performance in Non-smooth Federated Optimization with Adaptive Stepsizes
par: Sokolov, Igor, et autres
Publié: (2024)

Shadowheart SGD: Distributed Asynchronous SGD with Optimal Time Complexity Under Arbitrary Computation and Communication Heterogeneity
par: Tyurin, Alexander, et autres
Publié: (2024)

Accelerated Distributed Optimization with Compression and Error Feedback
par: Gao, Yuan, et autres
Publié: (2025)

On Biased Compression for Distributed Learning
par: Beznosikov, Aleksandr, et autres
Publié: (2020)

Second-order Optimization under Heavy-Tailed Noise: Hessian Clipping and Sample Complexity Limits
par: Sadiev, Abdurakhmon, et autres
Publié: (2025)

GradSkip: Communication-Accelerated Local Gradient Methods with Better Computational Complexity
par: Maranjyan, Artavazd, et autres
Publié: (2022)

Freya PAGE: First Optimal Time Complexity for Large-Scale Nonconvex Finite-Sum Optimization with Heterogeneous Asynchronous Computations
par: Tyurin, Alexander, et autres
Publié: (2024)

Methods for Convex $(L_0,L_1)$-Smooth Optimization: Clipping, Acceleration, and Adaptivity
par: Gorbunov, Eduard, et autres
Publié: (2024)

Gluon: Making Muon & Scion Great Again! (Bridging Theory and Practice of LMO-based Optimizers for LLMs)
par: Riabinin, Artem, et autres
Publié: (2025)

Rescaled Asynchronous SGD: Optimal Distributed Optimization under Data and System Heterogeneity
par: Mahran, Ammar, et autres
Publié: (2026)

Towards a Better Theoretical Understanding of Independent Subnetwork Training
par: Shulgin, Egor, et autres
Publié: (2023)

A Novel Unified Parametric Assumption for Nonconvex Optimization
par: Riabinin, Artem, et autres
Publié: (2025)

A Unified Theory of Stochastic Proximal Point Methods without Smoothness
par: Richtárik, Peter, et autres
Publié: (2024)

Smoothed Normalization for Efficient Distributed Private Optimization
par: Shulgin, Egor, et autres
Publié: (2025)

Federated Optimization with Doubly Regularized Drift Correction
par: Jiang, Xiaowen, et autres
Publié: (2024)