Cover Image

Biased Local SGD for Efficient Deep Learning on Heterogeneous Systems

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Lim, Jihyun, Jo, Junhyuk, Ko, Chanhyeok, Go, Young Min, Hwa, Jimin, Lee, Sunwoo
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Asynchronous Sharpness-Aware Minimization For Fast and Accurate Deep Learning
by: Jo, Junhyuk, et al.
Published: (2025)

Enabling Weak Client Participation via On-device Knowledge Distillation in Heterogeneous Federated Learning
by: Lim, Jihyun, et al.
Published: (2025)

Weight Concentration Regularization for Improving Pruning Robustness Under High Sparsity
by: Yun, Vincent-Daniel, et al.
Published: (2025)

Layer-wise Adaptive Gradient Norm Penalizing Method for Efficient and Accurate Deep Learning
by: Lee, Sunwoo
Published: (2025)

Ghosted Layers: Unconstrained Activation Alignment for Recovering Layer-Pruned LLMs
by: Yun, Vincent-Daniel, et al.
Published: (2026)

Deep Learning and Matrix Completion-aided IoT Network Localization in the Outlier Scenarios
by: Kim, Sunwoo
Published: (2025)

An Adversarial Learning Approach to Irregular Time-Series Forecasting
by: Nam, Heejeong, et al.
Published: (2024)

Layer-wise Update Aggregation with Recycling for Communication-Efficient Federated Learning
by: Kim, Jisoo, et al.
Published: (2025)

Locality-Aware Redundancy Pruning for LLM Depth Compression
by: Yun, Vincent-Daniel, et al.
Published: (2026)

Pseudo-Asynchronous Local SGD: Robust and Efficient Data-Parallel Training
by: Naganuma, Hiroki, et al.
Published: (2025)

UMATO: Bridging Local and Global Structures for Reliable Visual Analytics with Dimensionality Reduction
by: Jeon, Hyeon, et al.
Published: (2025)

Interaction-Breaking Adversarial Learning Framework for Robust Multi-Agent Reinforcement Learning
by: Lee, Sunwoo, et al.
Published: (2026)

The Limits and Potentials of Local SGD for Distributed Heterogeneous Learning with Intermittent Communication
by: Patel, Kumar Kshitij, et al.
Published: (2024)

FoX: Formation-aware exploration in multi-agent reinforcement learning
by: Jo, Yonghyeon, et al.
Published: (2023)

The Good, The Efficient and the Inductive Biases: Exploring Efficiency in Deep Learning Through the Use of Inductive Biases
by: Romero, David W.
Published: (2024)

Wolfpack Adversarial Attack for Robust Multi-Agent Reinforcement Learning
by: Lee, Sunwoo, et al.
Published: (2025)

MindFlayer SGD: Efficient Parallel SGD in the Presence of Heterogeneous and Random Worker Compute Times
by: Maranjyan, Artavazd, et al.
Published: (2024)

Can SGD Select Good Fishermen? Local Convergence under Self-Selection Biases and Beyond
by: Kalavasis, Alkis, et al.
Published: (2025)

Demystifying SGD with Doubly Stochastic Gradients
by: Kim, Kyurae, et al.
Published: (2024)

Non-Asymptotic Analysis of Online Local Private Learning with SGD
by: Shi, Enze, et al.
Published: (2025)

Dynamic Rank Adjustment for Accurate and Efficient Neural Network Training
by: Shin, Hyuntak, et al.
Published: (2025)

Shaping Zero-Shot Coordination via State Blocking
by: Kang, Mingu, et al.
Published: (2026)

Shadowheart SGD: Distributed Asynchronous SGD with Optimal Time Complexity Under Arbitrary Computation and Communication Heterogeneity
by: Tyurin, Alexander, et al.
Published: (2024)

Dual-Delayed Asynchronous SGD for Arbitrarily Heterogeneous Data
by: Wang, Xiaolu, et al.
Published: (2024)

Trustworthy Efficient Communication for Distributed Learning using LQ-SGD Algorithm
by: Li, Hongyang, et al.
Published: (2025)

SLowcal-SGD: Slow Query Points Improve Local-SGD for Stochastic Convex Optimization
by: Dahan, Tehila, et al.
Published: (2023)

Focusing Influence Mechanism for Multi-Agent Reinforcement Learning
by: Park, Yisak, et al.
Published: (2025)

RL-BioAug: Label-Efficient Reinforcement Learning for Self-Supervised EEG Representation Learning
by: Lee, Cheol-Hui, et al.
Published: (2026)

Understanding Outer Optimizers in Local SGD: Learning Rates, Momentum, and Acceleration
by: Khaled, Ahmed, et al.
Published: (2025)

On The Hidden Biases of Flow Matching Samplers
by: Lim, Soon Hoe
Published: (2025)

Handling Device Heterogeneity for Deep Learning-based Localization
by: Shokry, Ahmed, et al.
Published: (2024)

Biased Federated Learning under Wireless Heterogeneity
by: Abrar, Muhammad Faraz Ul, et al.
Published: (2025)

Asynchronous Local-SGD Training for Language Modeling
by: Liu, Bo, et al.
Published: (2024)

Predicting Social Media Engagement from Emotional and Temporal Features
by: Kim, Yunwoo, et al.
Published: (2025)

AutoHete: An Automatic and Efficient Heterogeneous Training System for LLMs
by: Zeng, Zihao, et al.
Published: (2025)

NeuralBeta: Estimating Beta Using Deep Learning
by: Liu, Yuxin, et al.
Published: (2024)

Biased Over-the-Air Federated Learning under Wireless Heterogeneity
by: Abrar, Muhammad Faraz Ul, et al.
Published: (2024)

The Benefits of Temporal Correlations: SGD Learns k-Juntas from Random Walks Efficiently
by: Cornacchia, Elisabetta, et al.
Published: (2026)

SLADE: Detecting Dynamic Anomalies in Edge Streams without Labels via Self-Supervised Learning
by: Lee, Jongha, et al.
Published: (2024)

BSG4Bot: Efficient Bot Detection based on Biased Heterogeneous Subgraphs
by: Miao, Hao, et al.
Published: (2024)