Copertina

Convergence of Sign-based Random Reshuffling Algorithms for Nonconvex Optimization

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Qin, Zhen, Liu, Zhishuai, Xu, Pan
Natura:	Preprint
Pubblicazione:	2023
Soggetti:	Machine Learning Distributed, Parallel, and Cluster Computing Optimization and Control
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Achieving Near-Optimal Convergence for Distributed Minimax Optimization with Adaptive Stepsizes
di: Huang, Yan, et al.
Pubblicazione: (2024)

Decentralized Nonconvex Optimization under Heavy-Tailed Noise: Normalization and Optimal Convergence
di: Yu, Shuhua, et al.
Pubblicazione: (2025)

Decentralized Nonconvex Composite Federated Learning with Gradient Tracking and Momentum
di: Zhou, Yuan, et al.
Pubblicazione: (2025)

A Stochastic Approximation Approach for Efficient Decentralized Optimization on Random Networks
di: Yau, Chung-Yiu, et al.
Pubblicazione: (2024)

Correlated Quantization for Faster Nonconvex Distributed Optimization
di: Panferov, Andrei, et al.
Pubblicazione: (2024)

A Survey of Optimization Methods for Training DL Models: Theoretical Perspective on Convergence and Generalization
di: Wang, Jing, et al.
Pubblicazione: (2025)

A Single-Loop Algorithm for Decentralized Bilevel Optimization
di: Dong, Youran, et al.
Pubblicazione: (2023)

Lower Bounds and Accelerated Algorithms in Distributed Stochastic Optimization with Communication Compression
di: He, Yutong, et al.
Pubblicazione: (2023)

S$^3$LDBO: A Snapshot Single-Loop Algorithm for Decentralized Bilevel Optimization
di: Yin, Chao, et al.
Pubblicazione: (2026)

Decentralized Nonsmooth Nonconvex Optimization with Client Sampling
di: Chen, Xinyan, et al.
Pubblicazione: (2026)

Problem-Parameter-Free Decentralized Nonconvex Stochastic Optimization
di: Li, Jiaxiang, et al.
Pubblicazione: (2024)

A Bias-Correction Decentralized Stochastic Gradient Algorithm with Momentum Acceleration
di: Hu, Yuchen, et al.
Pubblicazione: (2025)

A Double Tracking Method for Optimization with Decentralized Generalized Orthogonality Constraints
di: Wang, Lei, et al.
Pubblicazione: (2024)

AGD: an Auto-switchable Optimizer using Stepwise Gradient Difference for Preconditioning Matrix
di: Yue, Yun, et al.
Pubblicazione: (2023)

LoDAdaC: a unified local training-based decentralized framework with adaptive gradients and compressed communication
di: Liu, Wei, et al.
Pubblicazione: (2026)

MindFlayer SGD: Efficient Parallel SGD in the Presence of Heterogeneous and Random Worker Compute Times
di: Maranjyan, Artavazd, et al.
Pubblicazione: (2024)

Distributed Saddle-Point Problems: Lower Bounds, Near-Optimal and Robust Algorithms
di: Beznosikov, Aleksandr, et al.
Pubblicazione: (2020)

Efficient Adaptive Federated Optimization
di: Lee, Su Hyeong, et al.
Pubblicazione: (2024)

High-Performance Hybrid Algorithm for Minimum Sum-of-Squares Clustering of Infinitely Tall Data
di: Mussabayev, Ravil, et al.
Pubblicazione: (2023)

CONGO: Compressive Online Gradient Optimization
di: Carleton, Jeremy, et al.
Pubblicazione: (2024)

On Principled Local Optimization Methods for Federated Learning
di: Yuan, Honglin
Pubblicazione: (2024)

Optimizing Stochastic Gradient Push under Broadcast Communications
di: Nguyen, Tuan, et al.
Pubblicazione: (2026)

Communication-Efficient Federated Optimization over Semi-Decentralized Networks
di: Wang, He, et al.
Pubblicazione: (2023)

Unbiased Compression Saves Communication in Distributed Optimization: When and How Much?
di: He, Yutong, et al.
Pubblicazione: (2023)

Accelerating Distributed Optimization: A Primal-Dual Perspective on Local Steps
di: Yang, Junchi, et al.
Pubblicazione: (2024)

Communication-Efficient Federated Bilevel Optimization with Local and Global Lower Level Problems
di: Li, Junyi, et al.
Pubblicazione: (2023)

Accelerated Methods with Compressed Communications for Distributed Optimization Problems under Data Similarity
di: Bylinkin, Dmitry, et al.
Pubblicazione: (2024)

Rescaled Asynchronous SGD: Optimal Distributed Optimization under Data and System Heterogeneity
di: Mahran, Ammar, et al.
Pubblicazione: (2026)

Proving the Limited Scalability of Centralized Distributed Optimization via a New Lower Bound Construction
di: Tyurin, Alexander
Pubblicazione: (2025)

Rennala MVR: Improved Time Complexity for Parallel Stochastic Optimization via Momentum-Based Variance Reduction
di: Tovmasyan, Zhirayr, et al.
Pubblicazione: (2026)

A Hybrid Stochastic Gradient Tracking Method for Distributed Online Optimization Over Time-Varying Directed Networks
di: Shi, Xinli, et al.
Pubblicazione: (2025)

GRAWA: Gradient-based Weighted Averaging for Distributed Training of Deep Learning Models
di: Dimlioglu, Tolga, et al.
Pubblicazione: (2024)

Residual-Evasive Attacks on ADMM in Distributed Optimization
di: Bruckmeier, Sabrina, et al.
Pubblicazione: (2025)

Towards Dynamic Resource Allocation and Client Scheduling in Hierarchical Federated Learning: A Two-Phase Deep Reinforcement Learning Approach
di: Chen, Xiaojing, et al.
Pubblicazione: (2024)

Decentralized Directed Collaboration for Personalized Federated Learning
di: Liu, Yingqi, et al.
Pubblicazione: (2024)

FIARSE: Model-Heterogeneous Federated Learning via Importance-Aware Submodel Extraction
di: Wu, Feijie, et al.
Pubblicazione: (2024)

A Privacy Preserving Randomized Gossip Algorithm via Controlled Noise Insertion
di: Hanzely, Filip, et al.
Pubblicazione: (2019)

Stochastic Controlled Averaging for Federated Learning with Communication Compression
di: Huang, Xinmeng, et al.
Pubblicazione: (2023)

Dynamic Regularized Sharpness Aware Minimization in Federated Learning: Approaching Global Consistency and Smooth Landscape
di: Sun, Yan, et al.
Pubblicazione: (2023)

Online Distributed Learning with Quantized Finite-Time Coordination
di: Bastianello, Nicola, et al.
Pubblicazione: (2023)