Cover Image

Ordered Local Momentum for Asynchronous Distributed Learning under Arbitrary Delays

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Shi, Chang-Wei, Wang, Shi-Shang, Li, Wu-Jun
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Ordered Momentum for Asynchronous SGD
by: Shi, Chang-Wei, et al.
Published: (2024)

Global Momentum Compression for Sparse Communication in Distributed Learning
by: Shi, Chang-Wei, et al.
Published: (2019)

Bringing Order to Asynchronous SGD: Towards Optimality under Data-Dependent Delays with Momentum
by: Dahan, Tehila, et al.
Published: (2026)

Asynchronous Training Schemes in Distributed Learning with Time Delay
by: Wang, Haoxiang, et al.
Published: (2022)

Stochastic Normalized Gradient Descent with Momentum for Large-Batch Training
by: Zhao, Shen-Yi, et al.
Published: (2020)

Momentum Approximation in Asynchronous Private Federated Learning
by: Yu, Tao, et al.
Published: (2024)

Asynchronous Distributed Optimization with Delay-free Parameters
by: Wu, Xuyang, et al.
Published: (2023)

Faster Stochastic Optimization with Arbitrary Delays via Asynchronous Mini-Batching
by: Attia, Amit, et al.
Published: (2024)

Asynchronous Federated Stochastic Optimization for Heterogeneous Objectives Under Arbitrary Delays
by: Iakovidou, Charikleia, et al.
Published: (2024)

Achieving Linear Speedup in Asynchronous Federated Learning with Heterogeneous Clients
by: Wang, Xiaolu, et al.
Published: (2024)

Dual-Delayed Asynchronous SGD for Arbitrarily Heterogeneous Data
by: Wang, Xiaolu, et al.
Published: (2024)

Distributed Learning over Arbitrary Topology: Linear Speed-Up with Polynomial Transient Time
by: You, Runze, et al.
Published: (2025)

FedSUM Family: Efficient Federated Learning Methods under Arbitrary Client Participation
by: You, Runze, et al.
Published: (2025)

The Impact Analysis of Delays in Asynchronous Federated Learning with Data Heterogeneity for Edge Intelligence
by: Hao, Ziruo, et al.
Published: (2025)

Resource Efficient Asynchronous Federated Learning for Digital Twin Empowered IoT Network
by: Chu, Shunfeng, et al.
Published: (2024)

Asynchronous Local Computations in Distributed Bayesian Learning
by: Bhar, Kinjal, et al.
Published: (2023)

Analysis of Asynchronous Federated Learning: Unraveling the Interactions between Gradient Compression, Delay, and Data Heterogeneity
by: Yang, Diying, et al.
Published: (2025)

FLUX: Efficient Descriptor-Driven Clustered Federated Learning under Arbitrary Distribution Shifts
by: Fenoglio, Dario, et al.
Published: (2025)

Asynchronous Decentralized SGD under Non-Convexity: A Block-Coordinate Descent Framework
by: Zhou, Yijie, et al.
Published: (2025)

Distributed Sign Momentum with Local Steps for Training Transformers
by: Yu, Shuhua, et al.
Published: (2024)

Harnessing Feature Resonance under Arbitrary Target Alignment for Out-of-Distribution Node Detection
by: Yang, Shenzhi, et al.
Published: (2025)

Shadowheart SGD: Distributed Asynchronous SGD with Optimal Time Complexity Under Arbitrary Computation and Communication Heterogeneity
by: Tyurin, Alexander, et al.
Published: (2024)

Buffered Asynchronous Secure Aggregation for Cross-Device Federated Learning
by: Wang, Kun, et al.
Published: (2024)

Double Momentum Method for Lower-Level Constrained Bilevel Optimization
by: Shi, Wanli, et al.
Published: (2024)

Dynamic Momentum Recalibration in Online Gradient Learning
by: Yao, Zhipeng, et al.
Published: (2026)

AcceRL: A Distributed Asynchronous Reinforcement Learning and World Model Framework for Vision-Language-Action Models
by: Lu, Chengxuan, et al.
Published: (2026)

Revisiting Multi-Agent Asynchronous Online Optimization with Delays: the Strongly Convex Case
by: Bao, Lingchan, et al.
Published: (2025)

Delay-Empowered Causal Hierarchical Reinforcement Learning
by: Zhao, Chenran, et al.
Published: (2026)

A Survey of Deep Graph Learning under Distribution Shifts: from Graph Out-of-Distribution Generalization to Adaptation
by: Zhang, Kexin, et al.
Published: (2024)

Learning Clinical Representations Under Systematic Distribution Shift
by: Zhang, Yuanyun, et al.
Published: (2026)

DistRL: An Asynchronous Distributed Reinforcement Learning Framework for On-Device Control Agents
by: Wang, Taiyi, et al.
Published: (2024)

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training
by: Kim, Geon-Woo, et al.
Published: (2025)

Distributed Gradient Descent for Functional Learning
by: Yu, Zhan, et al.
Published: (2023)

Orthogonal Calibration for Asynchronous Federated Learning
by: Zhang, Jiayun, et al.
Published: (2025)

Graph Fairness Learning under Distribution Shifts
by: Li, Yibo, et al.
Published: (2024)

Distributionally Robust Constrained Reinforcement Learning under Strong Duality
by: Zhang, Zhengfei, et al.
Published: (2024)

Asynchronous and Stochastic Distributed Resource Allocation
by: Li, Qiang, et al.
Published: (2025)

Asynchronous Diffusion Learning with Agent Subsampling and Local Updates
by: Rizk, Elsa, et al.
Published: (2024)

Delayed Momentum Aggregation: Communication-efficient Byzantine-robust Federated Learning with Partial Participation
by: Otsuka, Kaoru, et al.
Published: (2025)

On the Performance Analysis of Momentum Method: A Frequency Domain Perspective
by: Li, Xianliang, et al.
Published: (2024)