Image de couverture de livre

AYLA: Amplifying Gradient Sensitivity via Loss Transformation in Non-Convex Optimization

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteur principal:	Keslaki, Ben
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

DRIFT: Data Reduction via Informative Feature Transformation- Generalization Begins Before Deep Learning starts
par: Keslaki, Ben
Publié: (2025)

Stochastic Non-Smooth Convex Optimization with Unbounded Gradients
par: Kovalev, Dmitry
Publié: (2026)

Quantitative Convergence Analysis of Projected Stochastic Gradient Descent for Non-Convex Losses via the Goldstein Subdifferential
par: Zheng, Yuping, et autres
Publié: (2025)

Large Stepsize Gradient Descent for Logistic Loss: Non-Monotonicity of the Loss Improves Optimization Efficiency
par: Wu, Jingfeng, et autres
Publié: (2024)

Mitigating Gradient Overlap in Deep Residual Networks with Gradient Normalization for Improved Non-Convex Optimization
par: Yun, Juyoung
Publié: (2024)

Simple Optimizers for Convex Aligned Multi-Objective Optimization
par: Kretzu, Ben, et autres
Publié: (2025)

The Dimension Strikes Back with Gradients: Generalization of Gradient Methods in Stochastic Convex Optimization
par: Schliserman, Matan, et autres
Publié: (2024)

More Optimal Fractional-Order Stochastic Gradient Descent for Non-Convex Optimization Problems
par: Partohaghighi, Mohammad, et autres
Publié: (2025)

Bandit Convex Optimization with Gradient Prediction Adaptivity
par: Wang, Shuche, et autres
Publié: (2026)

Shuffling Momentum Gradient Algorithm for Convex Optimization
par: Tran, Trang H., et autres
Publié: (2024)

Improved Dimension Dependence for Bandit Convex Optimization with Gradient Variations
par: Yu, Hang, et autres
Publié: (2026)

On Convergence of Incremental Gradient for Non-Convex Smooth Functions
par: Koloskova, Anastasia, et autres
Publié: (2023)

Non-Convex Optimization with Spectral Radius Regularization
par: Sandler, Adam, et autres
Publié: (2021)

It's Our Loss: No Privacy Amplification for Hidden State DP-SGD With Non-Convex Loss
par: Annamalai, Meenatchi Sundaram Muthu Selva
Publié: (2024)

On Convex Optimization with Semi-Sensitive Features
par: Ghazi, Badih, et autres
Publié: (2024)

Non-Convex Optimization in Federated Learning via Variance Reduction and Adaptive Learning
par: Thakur, Dipanwita, et autres
Publié: (2024)

The Sample Complexity of Gradient Descent in Stochastic Convex Optimization
par: Livni, Roi
Publié: (2024)

Small Gradient Norm Regret for Online Convex Optimization
par: Gao, Wenzhi, et autres
Publié: (2026)

Adaptive Proximal Gradient Method for Convex Optimization
par: Malitsky, Yura, et autres
Publié: (2023)

Grokfast: Accelerated Grokking by Amplifying Slow Gradients
par: Lee, Jaerin, et autres
Publié: (2024)

Expressive Losses for Verified Robustness via Convex Combinations
par: De Palma, Alessandro, et autres
Publié: (2023)

Convex Distillation: Efficient Compression of Deep Networks via Convex Optimization
par: Varshney, Prateek, et autres
Publié: (2024)

Optimal Guarantees for Algorithmic Reproducibility and Gradient Complexity in Convex Optimization
par: Zhang, Liang, et autres
Publié: (2023)

An Accelerated Gradient Method for Convex Smooth Simple Bilevel Optimization
par: Cao, Jincheng, et autres
Publié: (2024)

How to Make the Gradients Small Privately: Improved Rates for Differentially Private Non-Convex Optimization
par: Lowy, Andrew, et autres
Publié: (2024)

Establishing Linear Surrogate Regret Bounds for Convex Smooth Losses via Convolutional Fenchel-Young Losses
par: Cao, Yuzhou, et autres
Publié: (2025)

Convergence Error Analysis of Reflected Gradient Langevin Dynamics for Globally Optimizing Non-Convex Constrained Problems
par: Sato, Kanji, et autres
Publié: (2022)

Loss Gradient Gaussian Width based Generalization and Optimization Guarantees
par: Banerjee, Arindam, et autres
Publié: (2024)

Federated Smoothing Proximal Gradient for Quantile Regression with Non-Convex Penalties
par: Mirzaeifard, Reza, et autres
Publié: (2024)

Projection-Free Online Convex Optimization with Time-Varying Constraints
par: Garber, Dan, et autres
Publié: (2024)

Non-stationary Bandit Convex Optimization: A Comprehensive Study
par: Liu, Xiaoqi, et autres
Publié: (2025)

Bayesian Risk-Sensitive Policy Optimization For MDPs With General Loss Functions
par: Wang, Xiaoshuang, et autres
Publié: (2025)

Nesterov Finds GRAAL: Optimal and Adaptive Gradient Method for Convex Optimization
par: Borodich, Ekaterina, et autres
Publié: (2025)

You Shall Pass: Dealing with the Zero-Gradient Problem in Predict and Optimize for Convex Optimization
par: Veviurko, Grigorii, et autres
Publié: (2023)

Efficient Test-Time Finetuning of LLMs via Convex Reconstruction and Gradient Caching
par: Khamis, Alaa, et autres
Publié: (2026)

Online Non-Stationary Stochastic Quasar-Convex Optimization
par: Pun, Yuen-Man, et autres
Publié: (2024)

Muon in Vision Transformers: Optimizer-Recipe Interactions and Gradient Spectra
par: Southworth, Ben S., et autres
Publié: (2026)

Understanding Transformer Optimization via Gradient Heterogeneity
par: Tomihari, Akiyoshi, et autres
Publié: (2025)

Bayesian Optimization for Non-Convex Two-Stage Stochastic Optimization Problems
par: Buckingham, Jack M., et autres
Publié: (2024)

Stochastic Momentum Methods for Non-smooth Non-Convex Finite-Sum Coupled Compositional Optimization
par: Chen, Xingyu, et autres
Publié: (2025)