Cover Image

Controlled disagreement improves generalization in decentralized training

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wang, Zesen, Johansson, Mikael
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Distributed, Parallel, and Cluster Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

From promise to practice: realizing high-performance decentralized training
by: Wang, Zesen, et al.
Published: (2024)

Non-convex composite federated learning with heterogeneous data
by: Zhang, Jiaojiao, et al.
Published: (2025)

Locally Differentially Private Online Federated Learning With Correlated Noise
by: Zhang, Jiaojiao, et al.
Published: (2024)

Nonconvex Federated Learning on Compact Smooth Submanifolds With Heterogeneous Data
by: Zhang, Jiaojiao, et al.
Published: (2024)

Semi-decentralized Federated Time Series Prediction with Client Availability Budgets
by: Bao, Yunkai, et al.
Published: (2025)

Differentially Private Online Federated Learning with Correlated Noise
by: Zhang, Jiaojiao, et al.
Published: (2024)

LoDAdaC: a unified local training-based decentralized framework with adaptive gradients and compressed communication
by: Liu, Wei, et al.
Published: (2026)

Distributed Learning based on 1-Bit Gradient Coding in the Presence of Stragglers
by: Li, Chengxi, et al.
Published: (2024)

Byzantine-Robust and Communication-Efficient Distributed Learning via Compressed Momentum Filtering
by: Liu, Changxin, et al.
Published: (2024)

FLMarket: Enabling Privacy-preserved Pre-training Data Pricing for Federated Learning
by: Wen, Zhenyu, et al.
Published: (2024)

Vertical Federated Learning Hybrid Local Pre-training
by: Li, Wenguo, et al.
Published: (2024)

Semi-decentralized Training of Spatio-Temporal Graph Neural Networks for Traffic Prediction
by: Kralj, Ivan, et al.
Published: (2024)

GPT-FL: Generative Pre-trained Model-Assisted Federated Learning
by: Zhang, Tuo, et al.
Published: (2023)

Carbon-aware decentralized dynamic task offloading in MIMO-MEC networks via multi-agent reinforcement learning
by: Zulfiqar, Mubshra, et al.
Published: (2026)

Exploiting Correlations in Federated Learning: Opportunities and Practical Limitations
by: Edin, Adrian, et al.
Published: (2026)

Temporal Predictive Coding for Gradient Compression in Distributed Learning
by: Edin, Adrian, et al.
Published: (2024)

When Swarm Learning meets energy series data: A decentralized collaborative learning design based on blockchain
by: Xu, Lei, et al.
Published: (2024)

Improving training time and GPU utilization in geo-distributed language model training
by: Palak, et al.
Published: (2024)

FastCHGNet: Training one Universal Interatomic Potential to 1.5 Hours with 32 GPUs
by: Zhou, Yuanchang, et al.
Published: (2024)

Event-Driven Online Vertical Federated Learning
by: Wang, Ganyu, et al.
Published: (2025)

TASP: Topology-aware Sequence Parallelism
by: Wang, Yida, et al.
Published: (2025)

FedNS: A Fast Sketching Newton-Type Algorithm for Federated Learning
by: Li, Jian, et al.
Published: (2024)

TDC-Cache: A Trustworthy Decentralized Cooperative Caching Framework for Web3.0
by: Chen, Jinyu, et al.
Published: (2025)

SAFL: Structure-Aware Personalized Federated Learning via Client-Specific Clustering and SCSI-Guided Model Pruning
by: Li, Nan, et al.
Published: (2025)

FEDBUD: Joint Incentive and Privacy Optimization for Resource-Constrained Federated Learning
by: Liu, Tao, et al.
Published: (2026)

FedAgg: Adaptive Federated Learning with Aggregated Gradients
by: Yuan, Wenhao, et al.
Published: (2023)

Tackling Intertwined Data and Device Heterogeneities in Federated Learning with Unlimited Staleness
by: Wang, Haoming, et al.
Published: (2023)

Efficient Data Distribution Estimation for Accelerated Federated Learning
by: Wang, Yuanli, et al.
Published: (2024)

Machine Learning-Based Research on the Adaptability of Adolescents to Online Education
by: Wang, Mingwei, et al.
Published: (2024)

Online Distributed Learning with Quantized Finite-Time Coordination
by: Bastianello, Nicola, et al.
Published: (2023)

Learnable Sparse Customization in Heterogeneous Edge Computing
by: Xue, Jingjing, et al.
Published: (2024)

Rehearsal-Free Continual Federated Learning with Synergistic Synaptic Intelligence
by: Li, Yichen, et al.
Published: (2024)

Empowering Distributed Training with Sparsity-driven Data Synchronization
by: Wang, Zhuang, et al.
Published: (2023)

Time-Series Learning for Proactive Fault Prediction in Distributed Systems with Deep Neural Structures
by: Wang, Yang, et al.
Published: (2025)

ServerlessLoRA: Minimizing Latency and Cost in Serverless Inference for LoRA-Based LLMs
by: Sui, Yifan, et al.
Published: (2025)

Canzona: A Unified, Asynchronous, and Load-Balanced Framework for Distributed Matrix-based Optimizers
by: Wang, Liangyu, et al.
Published: (2026)

DYNAMIX: RL-based Adaptive Batch Size Optimization in Distributed Machine Learning Systems
by: Dai, Yuanjun, et al.
Published: (2025)

Communication Efficient and Provable Federated Unlearning
by: Tao, Youming, et al.
Published: (2024)

Breaking the Training Barrier of Billion-Parameter Universal Machine Learning Interatomic Potentials
by: Zhou, Yuanchang, et al.
Published: (2026)

STAR: Decode-Phase Rescheduling for LLM Inference
by: Wang, Zhibin, et al.
Published: (2025)