Imagen de Portada

Efficient Private SCO for Heavy-Tailed Data via Averaged Clipping

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Jin, Chenhan, Zhou, Kaiwen, Han, Bo, Cheng, James, Zeng, Tieyong
Formato:	Preprint
Publicado:	2022
Materias:	Machine Learning Optimization and Control
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

From Gradient Clipping to Normalization for Heavy Tailed SGD
por: Hübler, Florian, et al.
Publicado: (2024)

Nonconvex Stochastic Optimization under Heavy-Tailed Noises: Optimal Convergence without Gradient Clipping
por: Liu, Zijian, et al.
Publicado: (2024)

Clipping Improves Adam-Norm and AdaGrad-Norm when the Noise Is Heavy-Tailed
por: Chezhegov, Savelii, et al.
Publicado: (2024)

Second-order Optimization under Heavy-Tailed Noise: Hessian Clipping and Sample Complexity Limits
por: Sadiev, Abdurakhmon, et al.
Publicado: (2025)

Clipped Gradient Methods for Nonsmooth Convex Optimization under Heavy-Tailed Noise: A Refined Analysis
por: Liu, Zijian
Publicado: (2025)

Revisiting Gradient Normalization and Clipping for Nonconvex SGD under Heavy-Tailed Noise: Necessity, Sufficiency, and Acceleration
por: Sun, Tao, et al.
Publicado: (2024)

Convergence of Clipped-SGD for Convex $(L_0,L_1)$-Smooth Optimization with Heavy-Tailed Noise
por: Chezhegov, Savelii, et al.
Publicado: (2025)

Differentially Private Clipped-SGD: High-Probability Convergence with Arbitrary Clipping Level
por: Khah, Saleh Vatan, et al.
Publicado: (2025)

Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization
por: Armacki, Aleksandar, et al.
Publicado: (2026)

Heavy-Tail Phenomenon in Decentralized SGD
por: Gurbuzbalaban, Mert, et al.
Publicado: (2022)

Can SGD Handle Heavy-Tailed Noise?
por: Fatkhullin, Ilyas, et al.
Publicado: (2025)

Muon with Nesterov Momentum: Heavy-Tailed Noise and (Randomized) Inexact Polar Decomposition
por: Choudhury, Sayantan, et al.
Publicado: (2026)

Stochastic Weakly Convex Optimization Under Heavy-Tailed Noises
por: Zhu, Tianxi, et al.
Publicado: (2025)

Sharp High-Probability Rates for Nonlinear SGD under Heavy-Tailed Noise via Symmetrization
por: Armacki, Aleksandar, et al.
Publicado: (2025)

Near-Optimal Decentralized Stochastic Nonconvex Optimization with Heavy-Tailed Noise
por: Wang, Menglian, et al.
Publicado: (2026)

Optimal Asynchronous Stochastic Nonconvex Optimization under Heavy-Tailed Noise
por: Wu, Yidong, et al.
Publicado: (2026)

In-Expectation Convergence of Stochastic Gradient Methods under Heavy-Tailed Noise
por: Liu, Zijian
Publicado: (2026)

Robust and Fast Training via Per-Sample Clipping
por: Nobile, Davide, et al.
Publicado: (2026)

Parameter-free Clipped Gradient Descent Meets Polyak
por: Takezawa, Yuki, et al.
Publicado: (2024)

Online Convex Optimization with Heavy Tails: Old Algorithms, New Regrets, and Applications
por: Liu, Zijian
Publicado: (2025)

Scale-Invariant Neural Network Optimization: Norm Geometry and Heavy-Tailed Noise
por: Zhang, Jiayu, et al.
Publicado: (2026)

High Probability Complexity Bounds for Non-Smooth Stochastic Optimization with Heavy-Tailed Noise
por: Gorbunov, Eduard, et al.
Publicado: (2021)

Efficient Tail-Aware Generative Optimization via Flow Model Fine-Tuning
por: Wang, Zifan, et al.
Publicado: (2026)

Muon Converges under Heavy-Tailed Noise: Nonconvex Hölder-Smooth Empirical Risk Minimization
por: Iiduka, Hideaki
Publicado: (2026)

High-Probability Convergence for Composite and Distributed Stochastic Minimization and Variational Inequalities with Heavy-Tailed Noise
por: Gorbunov, Eduard, et al.
Publicado: (2023)

Closing the Gaps: Optimality of Sample Average Approximation for Data-Driven Newsvendor Problems
por: Lyu, Jiameng, et al.
Publicado: (2024)

Concentration of General Stochastic Approximation Under Heavy-Tailed Markovian Noise
por: Agrawal, Shubhada, et al.
Publicado: (2026)

Heavy-Tailed and Long-Range Dependent Noise in Stochastic Approximation: A Finite-Time Analysis
por: Chandak, Siddharth, et al.
Publicado: (2026)

Non-Asymptotic Global Convergence of PPO-Clip
por: Liu, Yin, et al.
Publicado: (2025)

Boosting-Enabled Robust System Identification of Partially Observed LTI Systems Under Heavy-Tailed Noise
por: Kanakeri, Vinay, et al.
Publicado: (2025)

Algorithmic Stability of Stochastic Gradient Descent with Momentum under Heavy-Tailed Noise
por: Dang, Thanh, et al.
Publicado: (2025)

Can Adaptive Gradient Methods Converge under Heavy-Tailed Noise? A Case Study of AdaGrad
por: Liu, Zijian
Publicado: (2026)

Sign-Based Optimizers Are Effective Under Heavy-Tailed Noise
por: Yu, Dingzhi, et al.
Publicado: (2026)

Distribution Grid Line Outage Identification with Unknown Pattern and Performance Guarantee
por: Xiao, Chenhan, et al.
Publicado: (2023)

Why is Normalization Preferred? A Worst-Case Complexity Theory for Stochastically Preconditioned SGD under Heavy-Tailed Noise
por: Fang, Yuchen, et al.
Publicado: (2026)

Offline Policy Learning with Weight Clipping and Heaviside Composite Optimization
por: Liu, Jingren, et al.
Publicado: (2026)

Clipped SGD Algorithms for Performative Prediction: Tight Bounds for Clipping Bias and Remedies
por: Li, Qiang, et al.
Publicado: (2024)

Regularized Gradient Clipping Provably Trains Wide and Deep Neural Networks
por: Tucat, Matteo, et al.
Publicado: (2024)

Double Momentum and Error Feedback for Clipping with Fast Rates and Differential Privacy
por: Islamov, Rustem, et al.
Publicado: (2025)

Sign Operator for Coping with Heavy-Tailed Noise in Non-Convex Optimization: High Probability Bounds Under $(L_0, L_1)$-Smoothness
por: Kornilov, Nikita, et al.
Publicado: (2025)