Copertina

High-Probability Convergence for Composite and Distributed Stochastic Minimization and Variational Inequalities with Heavy-Tailed Noise

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Gorbunov, Eduard, Sadiev, Abdurakhmon, Danilova, Marina, Horváth, Samuel, Gidel, Gauthier, Dvurechensky, Pavel, Gasnikov, Alexander, Richtárik, Peter
Natura:	Preprint
Pubblicazione:	2023
Soggetti:	Optimization and Control Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

High Probability Complexity Bounds for Non-Smooth Stochastic Optimization with Heavy-Tailed Noise
di: Gorbunov, Eduard, et al.
Pubblicazione: (2021)

Tight Lower Bounds and Optimal Algorithms for Stochastic Nonconvex Optimization with Heavy-Tailed Noise
di: Fradin, Adrien, et al.
Pubblicazione: (2025)

Second-order Optimization under Heavy-Tailed Noise: Hessian Clipping and Sample Complexity Limits
di: Sadiev, Abdurakhmon, et al.
Pubblicazione: (2025)

Breaking the Heavy-Tailed Noise Barrier in Stochastic Optimization Problems
di: Puchkin, Nikita, et al.
Pubblicazione: (2023)

Error Feedback under $(L_0,L_1)$-Smoothness: Normalization and Momentum
di: Khirirat, Sarit, et al.
Pubblicazione: (2024)

Convergence of Clipped-SGD for Convex $(L_0,L_1)$-Smooth Optimization with Heavy-Tailed Noise
di: Chezhegov, Savelii, et al.
Pubblicazione: (2025)

Stochastic Proximal Point Methods for Monotone Inclusions under Expected Similarity
di: Sadiev, Abdurakhmon, et al.
Pubblicazione: (2024)

A Unified Theory of Stochastic Proximal Point Methods without Smoothness
di: Richtárik, Peter, et al.
Pubblicazione: (2024)

Clipping Improves Adam-Norm and AdaGrad-Norm when the Noise Is Heavy-Tailed
di: Chezhegov, Savelii, et al.
Pubblicazione: (2024)

Ringmaster LMO: Asynchronous Linear Minimization Oracle Momentum Method
di: Sadiev, Abdurakhmon, et al.
Pubblicazione: (2026)

A Unified Primal-Dual Recipe for Accelerating Three-Operator Splitting Methods
di: Sadiev, Abdurakhmon, et al.
Pubblicazione: (2026)

A Nesterov-Accelerated Primal-Dual Splitting Algorithm for Convex Nonsmooth Optimization
di: Condat, Laurent, et al.
Pubblicazione: (2026)

Differentially Private Random Block Coordinate Descent
di: Maranjyan, Artavazd, et al.
Pubblicazione: (2024)

SPAM: Stochastic Proximal Point Method with Momentum Variance Reduction for Non-convex Cross-Device Federated Learning
di: Karagulyan, Avetik, et al.
Pubblicazione: (2024)

Byzantine Robustness and Partial Participation Can Be Achieved at Once: Just Clip Gradient Differences
di: Malinovsky, Grigory, et al.
Pubblicazione: (2023)

Better LMO-based Momentum Methods with Second-Order Information
di: Khirirat, Sarit, et al.
Pubblicazione: (2025)

Randomized gradient-free methods in convex optimization
di: Gasnikov, Alexander, et al.
Pubblicazione: (2022)

Improved Convergence in Parameter-Agnostic Error Feedback through Momentum
di: Sadiev, Abdurakhmon, et al.
Pubblicazione: (2025)

Differentially Private Clipped-SGD: High-Probability Convergence with Arbitrary Clipping Level
di: Khah, Saleh Vatan, et al.
Pubblicazione: (2025)

Double Momentum and Error Feedback for Clipping with Fast Rates and Differential Privacy
di: Islamov, Rustem, et al.
Pubblicazione: (2025)

Bernoulli-LoRA: A Theoretical Framework for Randomized Low-Rank Adaptation
di: Sokolov, Igor, et al.
Pubblicazione: (2025)

Distributed Stochastic Optimization under Heavy-Tailed Noise: A Federated Mirror Descent Approach with High Probability Convergence
di: Yu, Zhan, et al.
Pubblicazione: (2025)

Linear Convergence Rate in Convex Setup is Possible! Gradient Descent Method Variants under $(L_0,L_1)$-Smoothness
di: Lobanov, Aleksandr, et al.
Pubblicazione: (2024)

Stochastic Frank-Wolfe: Unified Analysis and Zoo of Special Cases
di: Nazykov, Ruslan, et al.
Pubblicazione: (2024)

High Probability Bounds for Stochastic Subgradient Schemes with Heavy Tailed Noise
di: Parletta, Daniela A., et al.
Pubblicazione: (2022)

High Probability Convergence of Distributed Clipped Stochastic Gradient Descent with Heavy-tailed Noise
di: Yang, Yuchen, et al.
Pubblicazione: (2025)

Distributed Stochastic Optimization under Heavy-Tailed Noises
di: Sun, Chao, et al.
Pubblicazione: (2023)

In-Expectation Convergence of Stochastic Gradient Methods under Heavy-Tailed Noise
di: Liu, Zijian
Pubblicazione: (2026)

Methods for Convex $(L_0,L_1)$-Smooth Optimization: Clipping, Acceleration, and Adaptivity
di: Gorbunov, Eduard, et al.
Pubblicazione: (2024)

Methods with Local Steps and Random Reshuffling for Generally Smooth Non-Convex Federated Optimization
di: Demidovich, Yury, et al.
Pubblicazione: (2024)

First Order Methods with Markovian Noise: from Acceleration to Variational Inequalities
di: Beznosikov, Aleksandr, et al.
Pubblicazione: (2023)

Decentralized Personalized Federated Learning for Min-Max Problems
di: Borodich, Ekaterina, et al.
Pubblicazione: (2021)

Phase-Type Variational Autoencoders for Heavy-Tailed Data
di: Ziani, Abdelhakim, et al.
Pubblicazione: (2026)

Exploring Jacobian Inexactness in Second-Order Methods for Variational Inequalities: Lower Bounds, Optimal Algorithms and Quasi-Newton Approximations
di: Agafonov, Artem, et al.
Pubblicazione: (2024)

Decentralized Distributed Optimization for Saddle Point Problems
di: Rogozin, Alexander, et al.
Pubblicazione: (2021)

Median Clipping for Zeroth-order Non-Smooth Convex Optimization and Multi-Armed Bandit Problem with Heavy-tailed Symmetric Noise
di: Kornilov, Nikita, et al.
Pubblicazione: (2024)

Decentralised convex optimisation with probability-proportional-to-size quantization
di: Pasechniuk, Dmitrii, et al.
Pubblicazione: (2025)

Federated Learning Can Find Friends That Are Advantageous
di: Tupitsa, Nazarii, et al.
Pubblicazione: (2024)

Byzantine-Robust Optimization under $(L_0, L_1)$-Smoothness
di: Bolatov, Arman, et al.
Pubblicazione: (2026)

Sign Operator for Coping with Heavy-Tailed Noise in Non-Convex Optimization: High Probability Bounds Under $(L_0, L_1)$-Smoothness
di: Kornilov, Nikita, et al.
Pubblicazione: (2025)