Image de couverture de livre

Robust Stochastic Optimization via Gradient Quantile Clipping

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Merad, Ibrahim, Gaïffas, Stéphane
Format:	Preprint
Publié:	2023
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Convergence and concentration properties of constant step-size SGD through Markov chains
par: Merad, Ibrahim, et autres
Publié: (2023)

Online Inventory Problems: Beyond the i.i.d. Setting with Online Convex Optimization
par: Hihat, Massil, et autres
Publié: (2023)

Adaptive Gradient Clipping for Robust Federated Learning
par: Allouah, Youssef, et autres
Publié: (2024)

To Clip or not to Clip: the Dynamics of SGD with Gradient Clipping in High-Dimensions
par: Marshall, Noah, et autres
Publié: (2024)

Can Entry-Wise Clipping Give Spectral Control of Stochastic Gradients?
par: Song, Zitao, et autres
Publié: (2026)

Central Limit Theorems for Stochastic Gradient Descent Quantile Estimators
par: Wei, Ziyang, et autres
Publié: (2025)

Nonconvex Stochastic Optimization under Heavy-Tailed Noises: Optimal Convergence without Gradient Clipping
par: Liu, Zijian, et autres
Publié: (2024)

Industrializing Prediction-Powered Inference: The GLIDE Library for Reliable GenAI and Agentic Systems Evaluation
par: Martinon, Grégoire, et autres
Publié: (2026)

Boosting CVaR Policy Optimization with Quantile Gradients
par: Luo, Yudong, et autres
Publié: (2026)

Stochastic Re-weighted Gradient Descent via Distributionally Robust Optimization
par: Kumar, Ramnath, et autres
Publié: (2023)

Language verY Rare for All
par: Merad, Ibrahim, et autres
Publié: (2024)

CE-GPPO: Coordinating Entropy via Gradient-Preserving Clipping Policy Optimization in Reinforcement Learning
par: Su, Zhenpeng, et autres
Publié: (2025)

Klear-Reasoner: Advancing Reasoning Capability via Gradient-Preserving Clipping Policy Optimization
par: Su, Zhenpeng, et autres
Publié: (2025)

Robust Approximate Sampling via Stochastic Gradient Barker Dynamics
par: Mauri, Lorenzo, et autres
Publié: (2024)

Robust and Fast Training via Per-Sample Clipping
par: Nobile, Davide, et autres
Publié: (2026)

Tilted Quantile Gradient Updates for Quantile-Constrained Reinforcement Learning
par: Li, Chenglin, et autres
Publié: (2024)

Conformal-Style Quantile Analyses for Stochastic Bandits
par: Du, Chengyu, et autres
Publié: (2026)

From Gradient Clipping to Normalization for Heavy Tailed SGD
par: Hübler, Florian, et autres
Publié: (2024)

Parameter-free Clipped Gradient Descent Meets Polyak
par: Takezawa, Yuki, et autres
Publié: (2024)

Enabling Differentially Private Federated Learning for Speech Recognition: Benchmarks, Adaptive Optimizers and Gradient Clipping
par: Pelikan, Martin, et autres
Publié: (2023)

Online Importance Sampling for Stochastic Gradient Optimization
par: Salaün, Corentin, et autres
Publié: (2023)

Clipped Gradient Methods for Nonsmooth Convex Optimization under Heavy-Tailed Noise: A Refined Analysis
par: Liu, Zijian
Publié: (2025)

Gradient Shaping Beyond Clipping: A Functional Perspective on Update Magnitude Control
par: You, Haochen, et autres
Publié: (2025)

Revisit Micro-batch Clipping: Adaptive Data Pruning via Gradient Manipulation
par: Wang, Lun
Publié: (2024)

Clipping-Free Policy Optimization for Large Language Models
par: Çağatan, Ömer Veysel, et autres
Publié: (2026)

Optimized Gradient Clipping for Noisy Label Learning
par: Ye, Xichen, et autres
Publié: (2024)

The Dimension Strikes Back with Gradients: Generalization of Gradient Methods in Stochastic Convex Optimization
par: Schliserman, Matan, et autres
Publié: (2024)

Robust Stochastic Gradient Posterior Sampling with Lattice Based Discretisation
par: Mensch, Zier, et autres
Publié: (2026)

HELENE: Hessian Layer-wise Clipping and Gradient Annealing for Accelerating Fine-tuning LLM with Zeroth-order Optimization
par: Zhao, Huaqin, et autres
Publié: (2024)

Generalized Gradient Norm Clipping & Non-Euclidean $(L_0,L_1)$-Smoothness
par: Pethick, Thomas, et autres
Publié: (2025)

When Gradient Clipping Becomes a Control Mechanism for Differential Privacy in Deep Learning
par: Partohaghighi, Mohammad, et autres
Publié: (2026)

Regularized Gradient Clipping Provably Trains Wide and Deep Neural Networks
par: Tucat, Matteo, et autres
Publié: (2024)

Weight Clipping for Robust Conformal Inference under Unbounded Covariate Shifts
par: Wang, James, et autres
Publié: (2026)

Adaptive Sampling and Clipping for Private Worst-Case Group Optimization
par: Cairney-Leeming, Max, et autres
Publié: (2026)

Quantile Learn-Then-Test: Quantile-Based Risk Control for Hyperparameter Optimization
par: Farzaneh, Amirmohammad, et autres
Publié: (2024)

Byzantine Robustness and Partial Participation Can Be Achieved at Once: Just Clip Gradient Differences
par: Malinovsky, Grigory, et autres
Publié: (2023)

Enhancing Performance and Calibration in Quantile Hyperparameter Optimization
par: Doyle, Riccardo
Publié: (2025)

DCPO: Dynamic Clipping Policy Optimization
par: Yang, Shihui, et autres
Publié: (2025)

AGGC: Adaptive Group Gradient Clipping for Stabilizing Large Language Model Training
par: Li, Zhiyuan, et autres
Publié: (2026)

Generative Model via Quantile Assignment
par: Hrusanov, Georgi, et autres
Publié: (2026)