Cover Image

Non-ergodic linear convergence property of the delayed gradient descent under the strongly convexity and the Polyak-Łojasiewicz condition

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Choi, Hyung Jun, Choi, Woocheol, Seok, Jinmyoung
Format:	Preprint
Published:	2023
Subjects:	Optimization and Control Distributed, Parallel, and Cluster Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

On the convergence result of the gradient-push algorithm on directed graphs with constant stepsize
by: Choi, Woocheol, et al.
Published: (2023)

Exponential convergence of a distributed divide-and-conquer algorithm for constrained convex optimization on networks
by: Emirov, Nazar, et al.
Published: (2025)

Decentralized Gradient-Free Methods for Stochastic Non-Smooth Non-Convex Optimization
by: Lin, Zhenwei, et al.
Published: (2023)

Decentralized Nonconvex Optimization under Heavy-Tailed Noise: Normalization and Optimal Convergence
by: Yu, Shuhua, et al.
Published: (2025)

Smoothed Gradient Clipping and Error Feedback for Decentralized Optimization under Symmetric Heavy-Tailed Noise
by: Yu, Shuhua, et al.
Published: (2023)

Optimality in Decentralized Optimization under Bandwidth Constraints
by: Tyurin, Alexander
Published: (2026)

Load Balancing with Network Latencies via Distributed Gradient Descent
by: Balseiro, Santiago R., et al.
Published: (2025)

An Optimistic Gradient Tracking Method for Distributed Minimax Optimization
by: Huang, Yan, et al.
Published: (2025)

Tailoring Gradient Methods for Differentially-Private Distributed Optimization
by: Wang, Yongqiang, et al.
Published: (2022)

A First-Order Algorithm for Decentralised Min-Max Problems
by: Malitsky, Yura, et al.
Published: (2023)

Problem-Parameter-Free Decentralized Nonconvex Stochastic Optimization
by: Li, Jiaxiang, et al.
Published: (2024)

Temporal Parallelisation of the HJB Equation and Continuous-Time Linear Quadratic Control
by: Särkkä, Simo, et al.
Published: (2022)

Decentralized Distributed Optimization for Saddle Point Problems
by: Rogozin, Alexander, et al.
Published: (2021)

Decentralized Nonsmooth Nonconvex Optimization with Client Sampling
by: Chen, Xinyan, et al.
Published: (2026)

Distributed Stochastic Momentum Tracking with Local Updates: Achieving Optimal Communication and Iteration Complexities
by: Huang, Kun, et al.
Published: (2025)

Krylov Solvers for Interior Point Methods with Applications in Radiation Therapy and Support Vector Machines
by: Liu, Felix, et al.
Published: (2023)

From Sequential to Parallel: Reformulating Dynamic Programming as GPU Kernels for Large-Scale Stochastic Combinatorial Optimization
by: Zhao, Jingyi, et al.
Published: (2026)

Accelerating Optimal Power Flow with GPUs: SIMD Abstraction of Nonlinear Programs and Condensed-Space Interior-Point Methods
by: Shin, Sungho, et al.
Published: (2023)

Distributed Constraint-Coupled Optimization: Harnessing ADMM-consensus for robustness
by: Messilem, Mohamed Abdelmouamin, et al.
Published: (2025)

Large-Scale LLM Inference with Heterogeneous Workloads: Prefill-Decode Contention and Asymptotically Optimal Control
by: Lin, Ruihan, et al.
Published: (2026)

An efficient implementation of parallel simulated annealing algorithm in GPUs
by: Ferreiro, A. M., et al.
Published: (2024)

One-Point Feedback for Composite Optimization with Applications to Distributed and Federated Learning
by: Beznosikov, Aleksandr, et al.
Published: (2021)

Modeling Task Mapping for Data-intensive Applications in Heterogeneous Systems
by: Wilhelm, Martin, et al.
Published: (2022)

A GPU-Accelerated Distributed Algorithm for Optimal Power Flow in Distribution Systems
by: Ryu, Minseok, et al.
Published: (2025)

Average-case optimization analysis for distributed consensus algorithms on regular graphs
by: Nguyen, Nhat Trung, et al.
Published: (2024)

GPU-Accelerated Primal Heuristics for Mixed Integer Programming
by: Çördük, Akif, et al.
Published: (2025)

D-PDLP: Scaling PDLP to Distributed Multi-GPU Systems
by: Li, Hongpei, et al.
Published: (2026)

Distributed Constrained Combinatorial Optimization leveraging Hypergraph Neural Networks
by: Heydaribeni, Nasimeh, et al.
Published: (2023)

LoDAdaC: a unified local training-based decentralized framework with adaptive gradients and compressed communication
by: Liu, Wei, et al.
Published: (2026)

Optimizing Stochastic Gradient Push under Broadcast Communications
by: Nguyen, Tuan, et al.
Published: (2026)

On the convergence analysis of the decentralized projected gradient descent method
by: Choi, Woocheol, et al.
Published: (2023)

Efficient Federated Learning against Heterogeneous and Non-stationary Client Unavailability
by: Xiang, Ming, et al.
Published: (2024)

UniAP: Unifying Inter- and Intra-Layer Automatic Parallelism by Mixed Integer Quadratic Programming
by: Lin, Hao, et al.
Published: (2023)

Accelerated Methods with Compressed Communications for Distributed Optimization Problems under Data Similarity
by: Bylinkin, Dmitry, et al.
Published: (2024)

Rescaled Asynchronous SGD: Optimal Distributed Optimization under Data and System Heterogeneity
by: Mahran, Ammar, et al.
Published: (2026)

Ringleader ASGD: The First Asynchronous SGD with Optimal Time Complexity under Data Heterogeneity
by: Maranjyan, Artavazd, et al.
Published: (2025)

FedCanon: Non-Convex Composite Federated Learning with Efficient Proximal Operation on Heterogeneous Data
by: Zhou, Yuan, et al.
Published: (2025)

dHPR: A Distributed Halpern Peaceman--Rachford Method for Non-smooth Distributed Optimization Problems
by: Feng, Zhangcheng, et al.
Published: (2025)

A GPU-Accelerated Hybrid Method for a Class of Multi-Depot Vehicle Routing Problems
by: Lei, Zhenyu, et al.
Published: (2026)

Counterfactual simulations for large scale systems with burnout variables
by: Heymann, Benjamin
Published: (2025)