Copertina

A New Theoretical Perspective on Data Heterogeneity in Federated Optimization

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Wang, Jiayi, Wang, Shiqiang, Chen, Rong-Rong, Ji, Mingyue
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning Distributed, Parallel, and Cluster Computing Information Theory Optimization and Control
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Demystifying Why Local Aggregation Helps: Convergence Analysis of Hierarchical SGD
di: Wang, Jiayi, et al.
Pubblicazione: (2020)

A Unified Analysis of Federated Learning with Arbitrary Client Participation
di: Wang, Shiqiang, et al.
Pubblicazione: (2022)

A Lightweight Method for Tackling Unknown Participation Statistics in Federated Averaging
di: Wang, Shiqiang, et al.
Pubblicazione: (2023)

Uncoded Storage Coded Transmission Elastic Computing with Straggler Tolerance in Heterogeneous Systems
di: Zhong, Xi, et al.
Pubblicazione: (2024)

FADAS: Towards Federated Adaptive Asynchronous Optimization
di: Wang, Yujia, et al.
Pubblicazione: (2024)

A Survey of Optimization Methods for Training DL Models: Theoretical Perspective on Convergence and Generalization
di: Wang, Jing, et al.
Pubblicazione: (2025)

FIARSE: Model-Heterogeneous Federated Learning via Importance-Aware Submodel Extraction
di: Wu, Feijie, et al.
Pubblicazione: (2024)

FedCanon: Non-Convex Composite Federated Learning with Efficient Proximal Operation on Heterogeneous Data
di: Zhou, Yuan, et al.
Pubblicazione: (2025)

Communication-Efficient Federated Optimization over Semi-Decentralized Networks
di: Wang, He, et al.
Pubblicazione: (2023)

Rescaled Asynchronous SGD: Optimal Distributed Optimization under Data and System Heterogeneity
di: Mahran, Ammar, et al.
Pubblicazione: (2026)

Efficient Federated Learning against Heterogeneous and Non-stationary Client Unavailability
di: Xiang, Ming, et al.
Pubblicazione: (2024)

Efficient Adaptive Federated Optimization
di: Lee, Su Hyeong, et al.
Pubblicazione: (2024)

Vertical Federated Learning with Missing Features During Training and Inference
di: Valdeira, Pedro, et al.
Pubblicazione: (2024)

On Principled Local Optimization Methods for Federated Learning
di: Yuan, Honglin
Pubblicazione: (2024)

Communication-Efficient Device Scheduling for Federated Learning Using Lyapunov Optimization
di: Perazzone, Jake B., et al.
Pubblicazione: (2025)

First Provably Optimal Asynchronous SGD for Homogeneous and Heterogeneous Data
di: Maranjyan, Artavazd
Pubblicazione: (2026)

Accelerating Distributed Optimization: A Primal-Dual Perspective on Local Steps
di: Yang, Junchi, et al.
Pubblicazione: (2024)

Ringleader ASGD: The First Asynchronous SGD with Optimal Time Complexity under Data Heterogeneity
di: Maranjyan, Artavazd, et al.
Pubblicazione: (2025)

Communication-Efficient Federated Bilevel Optimization with Local and Global Lower Level Problems
di: Li, Junyi, et al.
Pubblicazione: (2023)

Decentralized Directed Collaboration for Personalized Federated Learning
di: Liu, Yingqi, et al.
Pubblicazione: (2024)

Towards Dynamic Resource Allocation and Client Scheduling in Hierarchical Federated Learning: A Two-Phase Deep Reinforcement Learning Approach
di: Chen, Xiaojing, et al.
Pubblicazione: (2024)

The Limits and Potentials of Local SGD for Distributed Heterogeneous Learning with Intermittent Communication
di: Patel, Kumar Kshitij, et al.
Pubblicazione: (2024)

A Double Tracking Method for Optimization with Decentralized Generalized Orthogonality Constraints
di: Wang, Lei, et al.
Pubblicazione: (2024)

S$^3$LDBO: A Snapshot Single-Loop Algorithm for Decentralized Bilevel Optimization
di: Yin, Chao, et al.
Pubblicazione: (2026)

Towards a Better Theoretical Understanding of Independent Subnetwork Training
di: Shulgin, Egor, et al.
Pubblicazione: (2023)

Accelerated Methods with Compressed Communications for Distributed Optimization Problems under Data Similarity
di: Bylinkin, Dmitry, et al.
Pubblicazione: (2024)

Proving the Limited Scalability of Centralized Distributed Optimization via a New Lower Bound Construction
di: Tyurin, Alexander
Pubblicazione: (2025)

Dynamic Regularized Sharpness Aware Minimization in Federated Learning: Approaching Global Consistency and Smooth Landscape
di: Sun, Yan, et al.
Pubblicazione: (2023)

Continuous-Time Analysis of Federated Averaging
di: Overman, Tom, et al.
Pubblicazione: (2025)

Adaptive Federated Learning with Auto-Tuned Clients
di: Kim, Junhyung Lyle, et al.
Pubblicazione: (2023)

Stochastic Controlled Averaging for Federated Learning with Communication Compression
di: Huang, Xinmeng, et al.
Pubblicazione: (2023)

Decentralized Personalized Federated Learning for Min-Max Problems
di: Borodich, Ekaterina, et al.
Pubblicazione: (2021)

MindFlayer SGD: Efficient Parallel SGD in the Presence of Heterogeneous and Random Worker Compute Times
di: Maranjyan, Artavazd, et al.
Pubblicazione: (2024)

Decentralized Nonconvex Composite Federated Learning with Gradient Tracking and Momentum
di: Zhou, Yuan, et al.
Pubblicazione: (2025)

Lower Bounds and Accelerated Algorithms in Distributed Stochastic Optimization with Communication Compression
di: He, Yutong, et al.
Pubblicazione: (2023)

Resource-Constrained Decentralized Federated Learning via Personalized Event-Triggering
di: Zehtabi, Shahryar, et al.
Pubblicazione: (2022)

A Single-Loop Algorithm for Decentralized Bilevel Optimization
di: Dong, Youran, et al.
Pubblicazione: (2023)

Time-varying Mixing Matrix Design for Energy-efficient Decentralized Federated Learning
di: Zhang, Xusheng, et al.
Pubblicazione: (2025)

BROADCAST: Reducing Both Stochastic and Compression Noise to Robustify Communication-Efficient Federated Learning
di: Zhu, Heng, et al.
Pubblicazione: (2021)

A Stochastic Approximation Approach for Efficient Decentralized Optimization on Random Networks
di: Yau, Chung-Yiu, et al.
Pubblicazione: (2024)