Distributed Stochastic Optimization under Heavy-Tailed Noise: A Federated Mirror Descent Approach with High Probability Convergence
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | Yu, Zhan, Liao, Lan, Yuan, Deming, Ho, Daniel W. C., Zhou, Ding-Xuan |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
Documents similaires
High-Probability Convergence Theory for Distributed Composite Optimization with Sub-Weibull Noises
par: Yu, Zhan, et autres
Publié: (2025)
par: Yu, Zhan, et autres
Publié: (2025)
High Probability Convergence of Distributed Clipped Stochastic Gradient Descent with Heavy-tailed Noise
par: Yang, Yuchen, et autres
Publié: (2025)
par: Yang, Yuchen, et autres
Publié: (2025)
Distributed Stochastic Optimization under Heavy-Tailed Noises
par: Sun, Chao, et autres
Publié: (2023)
par: Sun, Chao, et autres
Publié: (2023)
High-Probability Convergence for Composite and Distributed Stochastic Minimization and Variational Inequalities with Heavy-Tailed Noise
par: Gorbunov, Eduard, et autres
Publié: (2023)
par: Gorbunov, Eduard, et autres
Publié: (2023)
Nonconvex Stochastic Optimization under Heavy-Tailed Noises: Optimal Convergence without Gradient Clipping
par: Liu, Zijian, et autres
Publié: (2024)
par: Liu, Zijian, et autres
Publié: (2024)
High Probability Complexity Bounds for Non-Smooth Stochastic Optimization with Heavy-Tailed Noise
par: Gorbunov, Eduard, et autres
Publié: (2021)
par: Gorbunov, Eduard, et autres
Publié: (2021)
In-Expectation Convergence of Stochastic Gradient Methods under Heavy-Tailed Noise
par: Liu, Zijian
Publié: (2026)
par: Liu, Zijian
Publié: (2026)
Algorithmic Stability of Stochastic Gradient Descent with Momentum under Heavy-Tailed Noise
par: Dang, Thanh, et autres
Publié: (2025)
par: Dang, Thanh, et autres
Publié: (2025)
Distributed Stochastic Optimization for Non-Smooth and Weakly Convex Problems under Heavy-Tailed Noise
par: Hu, Jun, et autres
Publié: (2025)
par: Hu, Jun, et autres
Publié: (2025)
Distributed Stochastic Block Coordinate Descent for Time-Varying Multi-Agent Optimization
par: Yu, Zhan, et autres
Publié: (2019)
par: Yu, Zhan, et autres
Publié: (2019)
High Probability Convergence Bounds for Non-convex Stochastic Gradient Descent with Sub-Weibull Noise
par: Madden, Liam, et autres
Publié: (2020)
par: Madden, Liam, et autres
Publié: (2020)
Optimal Asynchronous Stochastic Nonconvex Optimization under Heavy-Tailed Noise
par: Wu, Yidong, et autres
Publié: (2026)
par: Wu, Yidong, et autres
Publié: (2026)
High Probability Bounds for Stochastic Subgradient Schemes with Heavy Tailed Noise
par: Parletta, Daniela A., et autres
Publié: (2022)
par: Parletta, Daniela A., et autres
Publié: (2022)
Stochastic Zeroth-Order Optimization Under Heavy-Tailed Noise
par: Bakkali, Taha El, et autres
Publié: (2026)
par: Bakkali, Taha El, et autres
Publié: (2026)
Decentralized Nonconvex Optimization under Heavy-Tailed Noise: Normalization and Optimal Convergence
par: Yu, Shuhua, et autres
Publié: (2025)
par: Yu, Shuhua, et autres
Publié: (2025)
Sharp High-Probability Rates for Nonlinear SGD under Heavy-Tailed Noise via Symmetrization
par: Armacki, Aleksandar, et autres
Publié: (2025)
par: Armacki, Aleksandar, et autres
Publié: (2025)
Generic Frameworks for Distributed Functional Optimization and Learning over Time-Varying Networks
par: Yu, Zhan, et autres
Publié: (2025)
par: Yu, Zhan, et autres
Publié: (2025)
Implicit Bias and Convergence of Matrix Stochastic Mirror Descent
par: Akhtiamov, Danil, et autres
Publié: (2026)
par: Akhtiamov, Danil, et autres
Publié: (2026)
Stochastic Weakly Convex Optimization Under Heavy-Tailed Noises
par: Zhu, Tianxi, et autres
Publié: (2025)
par: Zhu, Tianxi, et autres
Publié: (2025)
High-probability Convergence Bounds for Nonlinear Stochastic Gradient Descent Under Heavy-tailed Noise
par: Armacki, Aleksandar, et autres
Publié: (2023)
par: Armacki, Aleksandar, et autres
Publié: (2023)
Near-Optimal Decentralized Stochastic Nonconvex Optimization with Heavy-Tailed Noise
par: Wang, Menglian, et autres
Publié: (2026)
par: Wang, Menglian, et autres
Publié: (2026)
An Improved Analysis of the Clipped Stochastic subGradient Method under Heavy-Tailed Noise
par: Parletta, Daniela Angela, et autres
Publié: (2024)
par: Parletta, Daniela Angela, et autres
Publié: (2024)
High Probability Complexity Bounds of Trust-Region Stochastic Sequential Quadratic Programming with Heavy-Tailed Noise
par: Fang, Yuchen, et autres
Publié: (2025)
par: Fang, Yuchen, et autres
Publié: (2025)
Can SGD Handle Heavy-Tailed Noise?
par: Fatkhullin, Ilyas, et autres
Publié: (2025)
par: Fatkhullin, Ilyas, et autres
Publié: (2025)
Tight Lower Bounds and Optimal Algorithms for Stochastic Nonconvex Optimization with Heavy-Tailed Noise
par: Fradin, Adrien, et autres
Publié: (2025)
par: Fradin, Adrien, et autres
Publié: (2025)
Breaking the Heavy-Tailed Noise Barrier in Stochastic Optimization Problems
par: Puchkin, Nikita, et autres
Publié: (2023)
par: Puchkin, Nikita, et autres
Publié: (2023)
Almost Sure Convergence and Non-asymptotic Concentration Bounds for Stochastic Mirror Descent Algorithm
par: Paul, Anik Kumar, et autres
Publié: (2024)
par: Paul, Anik Kumar, et autres
Publié: (2024)
Stochastic Mirror Descent under Iterate-Dependent Markov Noise: Analysis in the Asymptotic and Finite Time Regimes
par: Paul, Anik Kumar, et autres
Publié: (2026)
par: Paul, Anik Kumar, et autres
Publié: (2026)
Muon Converges under Heavy-Tailed Noise: Nonconvex Hölder-Smooth Empirical Risk Minimization
par: Iiduka, Hideaki
Publié: (2026)
par: Iiduka, Hideaki
Publié: (2026)
Accelerated Convergence of Stochastic Heavy Ball Method under Anisotropic Gradient Noise
par: Pan, Rui, et autres
Publié: (2023)
par: Pan, Rui, et autres
Publié: (2023)
Distributed Online Stochastic Convex-Concave Optimization: Dynamic Regret Analyses under Single and Multiple Consensus Steps
par: Zhang, Wentao, et autres
Publié: (2025)
par: Zhang, Wentao, et autres
Publié: (2025)
Convergence of Clipped-SGD for Convex $(L_0,L_1)$-Smooth Optimization with Heavy-Tailed Noise
par: Chezhegov, Savelii, et autres
Publié: (2025)
par: Chezhegov, Savelii, et autres
Publié: (2025)
On the Convergence of Policy in Unregularized Policy Mirror Descent
par: Lin, Dachao, et autres
Publié: (2022)
par: Lin, Dachao, et autres
Publié: (2022)
Convergence Analysis of Stochastic Saddle Point Mirror Descent Algorithm -- A Projected Dynamical View Point
par: Paul, Anik Kumar, et autres
Publié: (2024)
par: Paul, Anik Kumar, et autres
Publié: (2024)
Can Adaptive Gradient Methods Converge under Heavy-Tailed Noise? A Case Study of AdaGrad
par: Liu, Zijian
Publié: (2026)
par: Liu, Zijian
Publié: (2026)
Sign Operator for Coping with Heavy-Tailed Noise in Non-Convex Optimization: High Probability Bounds Under $(L_0, L_1)$-Smoothness
par: Kornilov, Nikita, et autres
Publié: (2025)
par: Kornilov, Nikita, et autres
Publié: (2025)
Concentration of General Stochastic Approximation Under Heavy-Tailed Markovian Noise
par: Agrawal, Shubhada, et autres
Publié: (2026)
par: Agrawal, Shubhada, et autres
Publié: (2026)
Value Mirror Descent for Reinforcement Learning
par: Jia, Zhichao, et autres
Publié: (2026)
par: Jia, Zhichao, et autres
Publié: (2026)
Lipschitz-Free Mirror Descent Methods for Non-Smooth Optimization Problems
par: Yuan, Bowen, et autres
Publié: (2025)
par: Yuan, Bowen, et autres
Publié: (2025)
High-Probability Guarantees for Random Zeroth-Order (Stochastic) Gradient Descent
par: Ye, Haishan
Publié: (2026)
par: Ye, Haishan
Publié: (2026)
Documents similaires
-
High-Probability Convergence Theory for Distributed Composite Optimization with Sub-Weibull Noises
par: Yu, Zhan, et autres
Publié: (2025) -
High Probability Convergence of Distributed Clipped Stochastic Gradient Descent with Heavy-tailed Noise
par: Yang, Yuchen, et autres
Publié: (2025) -
Distributed Stochastic Optimization under Heavy-Tailed Noises
par: Sun, Chao, et autres
Publié: (2023) -
High-Probability Convergence for Composite and Distributed Stochastic Minimization and Variational Inequalities with Heavy-Tailed Noise
par: Gorbunov, Eduard, et autres
Publié: (2023) -
Nonconvex Stochastic Optimization under Heavy-Tailed Noises: Optimal Convergence without Gradient Clipping
par: Liu, Zijian, et autres
Publié: (2024)