Distributed Stochastic Optimization under Heavy-Tailed Noises
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | Sun, Chao, Zhang, Huiming, Chen, Bo, Yu, Li |
|---|---|
| Format: | Preprint |
| Publié: |
2023
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
Documents similaires
Distributed Stochastic Optimization for Non-Smooth and Weakly Convex Problems under Heavy-Tailed Noise
par: Hu, Jun, et autres
Publié: (2025)
par: Hu, Jun, et autres
Publié: (2025)
Median-of-Means for Nash Equilibrium Seeking in Heavy-Tailed Games
par: Sun, Chao, et autres
Publié: (2026)
par: Sun, Chao, et autres
Publié: (2026)
Stochastic Zeroth-Order Optimization Under Heavy-Tailed Noise
par: Bakkali, Taha El, et autres
Publié: (2026)
par: Bakkali, Taha El, et autres
Publié: (2026)
Distributed Stochastic Optimization under Heavy-Tailed Noise: A Federated Mirror Descent Approach with High Probability Convergence
par: Yu, Zhan, et autres
Publié: (2025)
par: Yu, Zhan, et autres
Publié: (2025)
Optimal Asynchronous Stochastic Nonconvex Optimization under Heavy-Tailed Noise
par: Wu, Yidong, et autres
Publié: (2026)
par: Wu, Yidong, et autres
Publié: (2026)
Stochastic Weakly Convex Optimization Under Heavy-Tailed Noises
par: Zhu, Tianxi, et autres
Publié: (2025)
par: Zhu, Tianxi, et autres
Publié: (2025)
An Improved Analysis of the Clipped Stochastic subGradient Method under Heavy-Tailed Noise
par: Parletta, Daniela Angela, et autres
Publié: (2024)
par: Parletta, Daniela Angela, et autres
Publié: (2024)
In-Expectation Convergence of Stochastic Gradient Methods under Heavy-Tailed Noise
par: Liu, Zijian
Publié: (2026)
par: Liu, Zijian
Publié: (2026)
Tight Lower Bounds and Optimal Algorithms for Stochastic Nonconvex Optimization with Heavy-Tailed Noise
par: Fradin, Adrien, et autres
Publié: (2025)
par: Fradin, Adrien, et autres
Publié: (2025)
Nonconvex Stochastic Optimization under Heavy-Tailed Noises: Optimal Convergence without Gradient Clipping
par: Liu, Zijian, et autres
Publié: (2024)
par: Liu, Zijian, et autres
Publié: (2024)
Near-Optimal Decentralized Stochastic Nonconvex Optimization with Heavy-Tailed Noise
par: Wang, Menglian, et autres
Publié: (2026)
par: Wang, Menglian, et autres
Publié: (2026)
Algorithmic Stability of Stochastic Gradient Descent with Momentum under Heavy-Tailed Noise
par: Dang, Thanh, et autres
Publié: (2025)
par: Dang, Thanh, et autres
Publié: (2025)
High Probability Complexity Bounds for Non-Smooth Stochastic Optimization with Heavy-Tailed Noise
par: Gorbunov, Eduard, et autres
Publié: (2021)
par: Gorbunov, Eduard, et autres
Publié: (2021)
Decentralized Nonconvex Optimization under Heavy-Tailed Noise: Normalization and Optimal Convergence
par: Yu, Shuhua, et autres
Publié: (2025)
par: Yu, Shuhua, et autres
Publié: (2025)
High-Probability Convergence for Composite and Distributed Stochastic Minimization and Variational Inequalities with Heavy-Tailed Noise
par: Gorbunov, Eduard, et autres
Publié: (2023)
par: Gorbunov, Eduard, et autres
Publié: (2023)
Sign-Based Optimizers Are Effective Under Heavy-Tailed Noise
par: Yu, Dingzhi, et autres
Publié: (2026)
par: Yu, Dingzhi, et autres
Publié: (2026)
Breaking the Heavy-Tailed Noise Barrier in Stochastic Optimization Problems
par: Puchkin, Nikita, et autres
Publié: (2023)
par: Puchkin, Nikita, et autres
Publié: (2023)
Smoothed Gradient Clipping and Error Feedback for Decentralized Optimization under Symmetric Heavy-Tailed Noise
par: Yu, Shuhua, et autres
Publié: (2023)
par: Yu, Shuhua, et autres
Publié: (2023)
Second-order Optimization under Heavy-Tailed Noise: Hessian Clipping and Sample Complexity Limits
par: Sadiev, Abdurakhmon, et autres
Publié: (2025)
par: Sadiev, Abdurakhmon, et autres
Publié: (2025)
Concentration of General Stochastic Approximation Under Heavy-Tailed Markovian Noise
par: Agrawal, Shubhada, et autres
Publié: (2026)
par: Agrawal, Shubhada, et autres
Publié: (2026)
Scale-Invariant Neural Network Optimization: Norm Geometry and Heavy-Tailed Noise
par: Zhang, Jiayu, et autres
Publié: (2026)
par: Zhang, Jiayu, et autres
Publié: (2026)
Heavy-Tailed and Long-Range Dependent Noise in Stochastic Approximation: A Finite-Time Analysis
par: Chandak, Siddharth, et autres
Publié: (2026)
par: Chandak, Siddharth, et autres
Publié: (2026)
Clipped Gradient Methods for Nonsmooth Convex Optimization under Heavy-Tailed Noise: A Refined Analysis
par: Liu, Zijian
Publié: (2025)
par: Liu, Zijian
Publié: (2025)
Revisiting Gradient Normalization and Clipping for Nonconvex SGD under Heavy-Tailed Noise: Necessity, Sufficiency, and Acceleration
par: Sun, Tao, et autres
Publié: (2024)
par: Sun, Tao, et autres
Publié: (2024)
Can SGD Handle Heavy-Tailed Noise?
par: Fatkhullin, Ilyas, et autres
Publié: (2025)
par: Fatkhullin, Ilyas, et autres
Publié: (2025)
High Probability Convergence of Distributed Clipped Stochastic Gradient Descent with Heavy-tailed Noise
par: Yang, Yuchen, et autres
Publié: (2025)
par: Yang, Yuchen, et autres
Publié: (2025)
Accelerated Convergence of Stochastic Heavy Ball Method under Anisotropic Gradient Noise
par: Pan, Rui, et autres
Publié: (2023)
par: Pan, Rui, et autres
Publié: (2023)
Why is Normalization Preferred? A Worst-Case Complexity Theory for Stochastically Preconditioned SGD under Heavy-Tailed Noise
par: Fang, Yuchen, et autres
Publié: (2026)
par: Fang, Yuchen, et autres
Publié: (2026)
Muon Converges under Heavy-Tailed Noise: Nonconvex Hölder-Smooth Empirical Risk Minimization
par: Iiduka, Hideaki
Publié: (2026)
par: Iiduka, Hideaki
Publié: (2026)
Sharp High-Probability Rates for Nonlinear SGD under Heavy-Tailed Noise via Symmetrization
par: Armacki, Aleksandar, et autres
Publié: (2025)
par: Armacki, Aleksandar, et autres
Publié: (2025)
Convergence of Clipped-SGD for Convex $(L_0,L_1)$-Smooth Optimization with Heavy-Tailed Noise
par: Chezhegov, Savelii, et autres
Publié: (2025)
par: Chezhegov, Savelii, et autres
Publié: (2025)
Can Adaptive Gradient Methods Converge under Heavy-Tailed Noise? A Case Study of AdaGrad
par: Liu, Zijian
Publié: (2026)
par: Liu, Zijian
Publié: (2026)
High Probability Bounds for Stochastic Subgradient Schemes with Heavy Tailed Noise
par: Parletta, Daniela A., et autres
Publié: (2022)
par: Parletta, Daniela A., et autres
Publié: (2022)
SHANG++: Robust Stochastic Acceleration under Multiplicative Noise
par: Yu, Yaxin, et autres
Publié: (2026)
par: Yu, Yaxin, et autres
Publié: (2026)
Robust Out-of-Distribution Stochastic Optimization
par: Li, Xianyu, et autres
Publié: (2026)
par: Li, Xianyu, et autres
Publié: (2026)
Muon with Nesterov Momentum: Heavy-Tailed Noise and (Randomized) Inexact Polar Decomposition
par: Choudhury, Sayantan, et autres
Publié: (2026)
par: Choudhury, Sayantan, et autres
Publié: (2026)
(Accelerated) Noise-adaptive Stochastic Heavy-Ball Momentum
par: Dang, Anh, et autres
Publié: (2024)
par: Dang, Anh, et autres
Publié: (2024)
Bayesian Inferential Motion Planning Using Heavy-Tailed Distributions
par: Vaziri, Ali, et autres
Publié: (2025)
par: Vaziri, Ali, et autres
Publié: (2025)
Distributed Stochastic Bilevel Optimization: Improved Complexity and Heterogeneity Analysis
par: Niu, Youcheng, et autres
Publié: (2023)
par: Niu, Youcheng, et autres
Publié: (2023)
Clipping Improves Adam-Norm and AdaGrad-Norm when the Noise Is Heavy-Tailed
par: Chezhegov, Savelii, et autres
Publié: (2024)
par: Chezhegov, Savelii, et autres
Publié: (2024)
Documents similaires
-
Distributed Stochastic Optimization for Non-Smooth and Weakly Convex Problems under Heavy-Tailed Noise
par: Hu, Jun, et autres
Publié: (2025) -
Median-of-Means for Nash Equilibrium Seeking in Heavy-Tailed Games
par: Sun, Chao, et autres
Publié: (2026) -
Stochastic Zeroth-Order Optimization Under Heavy-Tailed Noise
par: Bakkali, Taha El, et autres
Publié: (2026) -
Distributed Stochastic Optimization under Heavy-Tailed Noise: A Federated Mirror Descent Approach with High Probability Convergence
par: Yu, Zhan, et autres
Publié: (2025) -
Optimal Asynchronous Stochastic Nonconvex Optimization under Heavy-Tailed Noise
par: Wu, Yidong, et autres
Publié: (2026)