Cover Image

Topology-aware Generalization of Decentralized SGD

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhu, Tongtian, He, Fengxiang, Zhang, Lan, Niu, Zhengyang, Song, Mingli, Tao, Dacheng
Format:	Preprint
Published:	2022
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

DICE: Data Influence Cascade in Decentralized Learning
by: Zhu, Tongtian, et al.
Published: (2025)

Topology-aware Embedding Memory for Continual Learning on Expanding Networks
by: Zhang, Xikun, et al.
Published: (2024)

Stability and Generalization for Decentralized Markov SGD
by: Wang, Jiahuan, et al.
Published: (2026)

Unveiling High-Probability Generalization in Decentralized SGD
by: Wang, Jiahuan, et al.
Published: (2026)

Heavy-Tail Phenomenon in Decentralized SGD
by: Gurbuzbalaban, Mert, et al.
Published: (2022)

Improved Stability and Generalization Guarantees of the Decentralized SGD Algorithm
by: Bars, Batiste Le, et al.
Published: (2023)

Towards Understanding Generalization and Stability Gaps between Centralized and Decentralized Federated Learning
by: Sun, Yan, et al.
Published: (2023)

On the Surprising Effectiveness of a Single Global Merging in Decentralized Learning
by: Zhu, Tongtian, et al.
Published: (2025)

Optimal and Efficient Algorithms for Decentralized Online Convex Optimization
by: Wan, Yuanyu, et al.
Published: (2024)

Drawback of Enforcing Equivariance and its Compensation via the Lens of Expressive Power
by: Chen, Yuzhu, et al.
Published: (2025)

DFed-SST: Building Semantic- and Structure-aware Topologies for Decentralized Federated Graph Learning
by: Guo, Lianshuai, et al.
Published: (2025)

Tight Analysis of Decentralized SGD: A Markov Chain Perspective
by: Versini, Lucas, et al.
Published: (2026)

Improved Approximate Regret for Decentralized Online Continuous Submodular Maximization via Reductions
by: Wan, Yuanyu, et al.
Published: (2026)

DeXposure-FM: A Time-series, Graph Foundation Model for Credit Exposures and Stability on Decentralized Financial Networks
by: Shu, Aijie, et al.
Published: (2026)

High-Probability Convergence Guarantees of Decentralized SGD
by: Armacki, Aleksandar, et al.
Published: (2025)

Topology-aware Neural Flux Prediction Guided by Physics
by: Jiang, Haoyang, et al.
Published: (2025)

Structured and Fast Optimization: The Kronecker SGD Algorithm
by: Song, Zhao, et al.
Published: (2023)

Continual Learning on Graphs: Challenges, Solutions, and Opportunities
by: Zhang, Xikun, et al.
Published: (2024)

Ensuring Safety in an Uncertain Environment: Constrained MDPs via Stochastic Thresholds
by: Zuo, Qian, et al.
Published: (2025)

Generalization and Optimization of SGD with Lookahead
by: Li, Kangcheng, et al.
Published: (2025)

Minibatch and Local SGD: Algorithmic Stability and Linear Speedup in Generalization
by: Lei, Yunwen, et al.
Published: (2023)

Can SGD Handle Heavy-Tailed Noise?
by: Fatkhullin, Ilyas, et al.
Published: (2025)

Rethinking the Personalized Relaxed Initialization in the Federated Learning: Consistency and Generalization
by: Shen, Li, et al.
Published: (2026)

Is Centralized Training with Decentralized Execution Framework Centralized Enough for MARL?
by: Zhou, Yihe, et al.
Published: (2023)

Improved Dynamic Regret for Online Frank-Wolfe
by: Wan, Yuanyu, et al.
Published: (2023)

Rationality Measurement and Theory for Reinforcement Learning Agents
by: Qian, Kejiang, et al.
Published: (2026)

Near-Constant Strong Violation and Last-Iterate Convergence for Online CMDPs via Decaying Safety Margins
by: Zuo, Qian, et al.
Published: (2026)

Adaptive debiased SGD in high-dimensional GLMs with streaming data
by: Han, Ruijian, et al.
Published: (2024)

Asynchronous Decentralized SGD under Non-Convexity: A Block-Coordinate Descent Framework
by: Zhou, Yijie, et al.
Published: (2025)

Physics-Aligned Canonical Equivariant Fourier Neural Operator under Symmetry-Induced Shifts
by: Xu, Jiaxiao, et al.
Published: (2026)

Anon: Extrapolating Adaptivity Beyond SGD and Adam
by: Zhang, Yiheng, et al.
Published: (2026)

Topology-aware Robust Optimization for Out-of-distribution Generalization
by: Qiao, Fengchun, et al.
Published: (2023)

Leveraging Flatness to Improve Information-Theoretic Generalization Bounds for SGD
by: Peng, Ze, et al.
Published: (2026)

Scaling Laws of SignSGD in Linear Regression: When Does It Outperform SGD?
by: Kim, Jihwan, et al.
Published: (2026)

Stability and Generalization for Distributed SGDA
by: Zhu, Miaoxi, et al.
Published: (2024)

Federated Distillation: A Survey
by: Li, Lin, et al.
Published: (2024)

Convergent Differential Privacy Analysis for General Federated Learning
by: Sun, Yan, et al.
Published: (2024)

A2PO: Towards Effective Offline Reinforcement Learning from an Advantage-aware Perspective
by: Qing, Yunpeng, et al.
Published: (2024)

Q-resafe: Assessing Safety Risks and Quantization-aware Safety Patching for Quantized Large Language Models
by: Chen, Kejia, et al.
Published: (2025)

Generalisation of RLHF under Reward Shift and Clipped KL Regularisation
by: Tang, Kenton, et al.
Published: (2026)