Cover Image

Ordered Momentum for Asynchronous SGD

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Shi, Chang-Wei, Yang, Yi-Rui, Li, Wu-Jun
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Distributed, Parallel, and Cluster Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Birch SGD: A Tree Graph Framework for Local and Asynchronous SGD Methods
by: Tyurin, Alexander, et al.
Published: (2025)

Achieving Linear Speedup in Asynchronous Federated Learning with Heterogeneous Clients
by: Wang, Xiaolu, et al.
Published: (2024)

Resource Efficient Asynchronous Federated Learning for Digital Twin Empowered IoT Network
by: Chu, Shunfeng, et al.
Published: (2024)

Ringmaster ASGD: The First Asynchronous SGD with Optimal Time Complexity
by: Maranjyan, Artavazd, et al.
Published: (2025)

First Provably Optimal Asynchronous SGD for Homogeneous and Heterogeneous Data
by: Maranjyan, Artavazd
Published: (2026)

AReaL-Hex: Accommodating Asynchronous RL Training over Heterogeneous GPUs
by: Yan, Ran, et al.
Published: (2025)

Truncated Non-Uniform Quantization for Distributed SGD
by: Yan, Guangfeng, et al.
Published: (2024)

Asynchronous Personalized Federated Learning through Global Memorization
by: Wan, Fan, et al.
Published: (2025)

Rescaled Asynchronous SGD: Optimal Distributed Optimization under Data and System Heterogeneity
by: Mahran, Ammar, et al.
Published: (2026)

Cooperative SGD with Dynamic Mixing Matrices
by: Sarkar, Soumya, et al.
Published: (2025)

Ringleader ASGD: The First Asynchronous SGD with Optimal Time Complexity under Data Heterogeneity
by: Maranjyan, Artavazd, et al.
Published: (2025)

Asynchronous Federated Clustering with Unknown Number of Clusters
by: Zhang, Yunfan, et al.
Published: (2024)

Ringmaster LMO: Asynchronous Linear Minimization Oracle Momentum Method
by: Sadiev, Abdurakhmon, et al.
Published: (2026)

Byzantine-Robust and Communication-Efficient Distributed Learning via Compressed Momentum Filtering
by: Liu, Changxin, et al.
Published: (2024)

Corrected with the Latest Version: Make Robust Asynchronous Federated Learning Possible
by: Lu, Chaoyi, et al.
Published: (2025)

FedQS: Optimizing Gradient and Model Aggregation for Semi-Asynchronous Federated Learning
by: Li, Yunbo, et al.
Published: (2025)

Orthogonal Calibration for Asynchronous Federated Learning
by: Zhang, Jiayun, et al.
Published: (2025)

GAS: Generative Activation-Aided Asynchronous Split Federated Learning
by: Yang, Jiarong, et al.
Published: (2024)

DORA: A Scalable Asynchronous Reinforcement Learning System for Language Model Training
by: Hu, Tianhao, et al.
Published: (2026)

Asynchronous Multi-Model Dynamic Federated Learning over Wireless Networks: Theory, Modeling, and Optimization
by: Chang, Zhan-Lun, et al.
Published: (2023)

AMDP: Asynchronous Multi-Directional Pipeline Parallelism for Large-Scale Models Training
by: Chen, Ling, et al.
Published: (2026)

FlashEvolve: Accelerating Agent Self-Evolution with Asynchronous Stage Orchestration
by: Hu, Zhengding, et al.
Published: (2026)

Fast and Efficient 2-bit LLM Inference on GPU: 2/4/16-bit in a Weight Matrix with Asynchronous Dequantization
by: Li, Jinhao, et al.
Published: (2023)

CSAFL: A Clustered Semi-Asynchronous Federated Learning Framework
by: Zhang, Yu, et al.
Published: (2021)

Straggler-Resilient Decentralized Learning via Adaptive Asynchronous Updates
by: Xiong, Guojun, et al.
Published: (2023)

AsyncHZP: Hierarchical ZeRO Parallelism with Asynchronous Scheduling for Scalable LLM Training
by: Bai, Huawei, et al.
Published: (2025)

Canzona: A Unified, Asynchronous, and Load-Balanced Framework for Distributed Matrix-based Optimizers
by: Wang, Liangyu, et al.
Published: (2026)

SMoFi: Step-wise Momentum Fusion for Split Federated Learning on Heterogeneous Data
by: Yang, Mingkun, et al.
Published: (2025)

High-Dimensional Sparse Data Low-rank Representation via Accelerated Asynchronous Parallel Stochastic Gradient Descent
by: Hu, Qicong, et al.
Published: (2024)

FedAST: Federated Asynchronous Simultaneous Training
by: Askin, Baris, et al.
Published: (2024)

Nesterov Method for Asynchronous Pipeline Parallel Optimization
by: Ajanthan, Thalaiyasingam, et al.
Published: (2025)

CaBaFL: Asynchronous Federated Learning via Hierarchical Cache and Feature Balance
by: Xia, Zeke, et al.
Published: (2024)

Asynch-SGBDT: Asynchronous Parallel Stochastic Gradient Boosting Decision Tree based on Parameters Server
by: Daning, Cheng, et al.
Published: (2018)

AsyncMesh: Fully Asynchronous Optimization for Data and Pipeline Parallelism
by: Ajanthan, Thalaiyasingam, et al.
Published: (2026)

DataStates-LLM: Lazy Asynchronous Checkpointing for Large Language Models
by: Maurya, Avinash, et al.
Published: (2024)

Asynchronous Federated Stochastic Optimization for Heterogeneous Objectives Under Arbitrary Delays
by: Iakovidou, Charikleia, et al.
Published: (2024)

DOPPLER: Dual-Policy Learning for Device Assignment in Asynchronous Dataflow Graphs
by: Yao, Xinyu, et al.
Published: (2025)

Robust Fully-Asynchronous Methods for Distributed Training over General Architecture
by: Zhu, Zehan, et al.
Published: (2023)

Unity is Power: Semi-Asynchronous Collaborative Training of Large-Scale Models with Structured Pruning in Resource-Limited Clients
by: Li, Yan, et al.
Published: (2024)

Asyn2F: An Asynchronous Federated Learning Framework with Bidirectional Model Aggregation
by: Cao, Tien-Dung, et al.
Published: (2024)