Imagen de Portada

Efficient Distributed Optimization under Heavy-Tailed Noise

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Lee, Su Hyeong, Zaheer, Manzil, Li, Tian
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Efficient Adaptive Federated Optimization
por: Lee, Su Hyeong, et al.
Publicado: (2024)

Asynchronous Heavy-Tailed Optimization
por: Sun, Junfei, et al.
Publicado: (2026)

Differentially Private Model Merging
por: Yin, Qichuan, et al.
Publicado: (2026)

Federated Stochastic Minimax Optimization under Heavy-Tailed Noises
por: Zhang, Xinwen, et al.
Publicado: (2025)

Federation over Text: Insight Sharing for Multi-Agent Reasoning
por: Yao, Dixi, et al.
Publicado: (2026)

Stochastic Bilevel Optimization with Heavy-Tailed Noise
por: Liu, Zhuanghua, et al.
Publicado: (2025)

Optimal Asynchronous Stochastic Nonconvex Optimization under Heavy-Tailed Noise
por: Wu, Yidong, et al.
Publicado: (2026)

Stability and Generalization of Nonconvex Optimization with Heavy-Tailed Noise
por: Chen, Hongxu, et al.
Publicado: (2026)

Robust and Computationally Efficient Linear Contextual Bandits under Adversarial Corruption and Heavy-Tailed Noise
por: Tani, Naoto, et al.
Publicado: (2026)

A Statistical Framework for Data-dependent Retrieval-Augmented Models
por: Basu, Soumya, et al.
Publicado: (2024)

Stochastic Weakly Convex Optimization Under Heavy-Tailed Noises
por: Zhu, Tianxi, et al.
Publicado: (2025)

Second-order Optimization under Heavy-Tailed Noise: Hessian Clipping and Sample Complexity Limits
por: Sadiev, Abdurakhmon, et al.
Publicado: (2025)

Nonconvex Stochastic Optimization under Heavy-Tailed Noises: Optimal Convergence without Gradient Clipping
por: Liu, Zijian, et al.
Publicado: (2024)

In-Expectation Convergence of Stochastic Gradient Methods under Heavy-Tailed Noise
por: Liu, Zijian
Publicado: (2026)

Clipped Gradient Methods for Nonsmooth Convex Optimization under Heavy-Tailed Noise: A Refined Analysis
por: Liu, Zijian
Publicado: (2025)

Near-Optimal Decentralized Stochastic Nonconvex Optimization with Heavy-Tailed Noise
por: Wang, Menglian, et al.
Publicado: (2026)

Sign-Based Optimizers Are Effective Under Heavy-Tailed Noise
por: Yu, Dingzhi, et al.
Publicado: (2026)

Understanding Outer Optimizers in Local SGD: Learning Rates, Momentum, and Acceleration
por: Khaled, Ahmed, et al.
Publicado: (2025)

Can SGD Handle Heavy-Tailed Noise?
por: Fatkhullin, Ilyas, et al.
Publicado: (2025)

Scale-Invariant Neural Network Optimization: Norm Geometry and Heavy-Tailed Noise
por: Zhang, Jiayu, et al.
Publicado: (2026)

Algorithmic Stability of Stochastic Gradient Descent with Momentum under Heavy-Tailed Noise
por: Dang, Thanh, et al.
Publicado: (2025)

Breaking the Heavy-Tailed Noise Barrier in Stochastic Optimization Problems
por: Puchkin, Nikita, et al.
Publicado: (2023)

High Probability Complexity Bounds for Non-Smooth Stochastic Optimization with Heavy-Tailed Noise
por: Gorbunov, Eduard, et al.
Publicado: (2021)

High-Probability Convergence for Composite and Distributed Stochastic Minimization and Variational Inequalities with Heavy-Tailed Noise
por: Gorbunov, Eduard, et al.
Publicado: (2023)

Understanding Robust Machine Learning for Nonparametric Regression with Heavy-Tailed Noise
por: Feng, Yunlong, et al.
Publicado: (2025)

Sharp High-Probability Rates for Nonlinear SGD under Heavy-Tailed Noise via Symmetrization
por: Armacki, Aleksandar, et al.
Publicado: (2025)

Muon Converges under Heavy-Tailed Noise: Nonconvex Hölder-Smooth Empirical Risk Minimization
por: Iiduka, Hideaki
Publicado: (2026)

A Fresh Take on Stale Embeddings: Improving Dense Retriever Training with Corrector Networks
por: Monath, Nicholas, et al.
Publicado: (2024)

Privacy of SGD under Gaussian or Heavy-Tailed Noise: Guarantees without Gradient Clipping
por: Şimşekli, Umut, et al.
Publicado: (2024)

Adaptive Retrieval and Scalable Indexing for k-NN Search with Cross-Encoders
por: Yadav, Nishant, et al.
Publicado: (2024)

Cite Pretrain: Retrieval-Free Knowledge Attribution for Large Language Models
por: Huang, Yukun, et al.
Publicado: (2025)

Revisiting Gradient Normalization and Clipping for Nonconvex SGD under Heavy-Tailed Noise: Necessity, Sufficiency, and Acceleration
por: Sun, Tao, et al.
Publicado: (2024)

Convergence of Clipped-SGD for Convex $(L_0,L_1)$-Smooth Optimization with Heavy-Tailed Noise
por: Chezhegov, Savelii, et al.
Publicado: (2025)

Time-Varying Graph Learning for Data with Heavy-Tailed Distribution
por: Javaheri, Amirhossein, et al.
Publicado: (2024)

Tail Annealing for Heavy-Tailed Flow Matching
por: Pachebat, Jean
Publicado: (2026)

Can Adaptive Gradient Methods Converge under Heavy-Tailed Noise? A Case Study of AdaGrad
por: Liu, Zijian
Publicado: (2026)

ExeDec: Execution Decomposition for Compositional Generalization in Neural Program Synthesis
por: Shi, Kensen, et al.
Publicado: (2023)

On the Performance of Differentially Private Optimization with Heavy-Tail Class Imbalance
por: Tang, Qiaoyue, et al.
Publicado: (2025)

Concentration of General Stochastic Approximation Under Heavy-Tailed Markovian Noise
por: Agrawal, Shubhada, et al.
Publicado: (2026)

Uniform Mean Estimation for Heavy-Tailed Distributions via Median-of-Means
por: Høgsgaard, Mikael Møller, et al.
Publicado: (2025)