Image de couverture de livre

The Implicit Bias of Gradient Descent on Separable Multiclass Data

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Ravi, Hrithik, Scott, Clayton, Soudry, Daniel, Wang, Yutong
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

The Implicit Bias of Gradient Descent on Separable Data
par: Soudry, Daniel, et autres
Publié: (2017)

Implicit Bias of Spectral Descent and Muon on Multiclass Separable Data
par: Fan, Chen, et autres
Publié: (2025)

Unified Binary and Multiclass Margin-Based Classification
par: Wang, Yutong, et autres
Publié: (2023)

Towards The Implicit Bias on Multiclass Separable Data Under Norm Constraints
par: Xie, Shengping, et autres
Publié: (2026)

Multiclass Loss Geometry Matters for Generalization of Gradient Descent in Separable Classification
par: Schliserman, Matan, et autres
Publié: (2025)

Implicit Bias of Mirror Flow on Separable Data
par: Pesme, Scott, et autres
Publié: (2024)

The Implicit Bias of Steepest Descent with Mini-batch Stochastic Gradient
par: Li, Jichu, et autres
Publié: (2026)

Implicit Bias of Gradient Descent for Non-Homogeneous Deep Networks
par: Cai, Yuhang, et autres
Publié: (2025)

Convergence and Implicit Bias of Gradient Descent on Continual Linear Classification
par: Jung, Hyunji, et autres
Publié: (2025)

The Implicit Bias of Adam on Separable Data
par: Zhang, Chenyang, et autres
Publié: (2024)

PLUMAGE: Probabilistic Low rank Unbiased Min Variance Gradient Estimator for Efficient Large Model Training
par: Haroush, Matan, et autres
Publié: (2025)

Feature Averaging: An Implicit Bias of Gradient Descent Leading to Non-Robustness in Neural Networks
par: Li, Binghui, et autres
Publié: (2024)

Training Instabilities Induce Flatness Bias in Gradient Descent
par: Wang, Lawrence, et autres
Publié: (2025)

Gradient Descent on Logistic Regression with Non-Separable Data and Large Step Sizes
par: Meng, Si Yi, et autres
Publié: (2024)

Any-stepsize Gradient Descent for Separable Data under Fenchel-Young Losses
par: Bao, Han, et autres
Publié: (2025)

Implicit Bias and Convergence of Matrix Stochastic Mirror Descent
par: Akhtiamov, Danil, et autres
Publié: (2026)

How Does the ReLU Activation Affect the Implicit Bias of Gradient Descent on High-dimensional Neural Network Regression?
par: Lai, Kuo-Wei, et autres
Publié: (2026)

Flavors of Margin: Implicit Bias of Steepest Descent in Homogeneous Neural Networks
par: Tsilivis, Nikolaos, et autres
Publié: (2024)

Turning Stale Gradients into Stable Gradients: Coherent Coordinate Descent with Implicit Landscape Smoothing for Lightweight Zeroth-Order Optimization
par: Liang, Chen, et autres
Publié: (2026)

Minimum Variance Unbiased N:M Sparsity for the Neural Gradients
par: Chmiel, Brian, et autres
Publié: (2022)

Understanding the Implicit Regularization of Gradient Descent in Over-parameterized Models
par: Ma, Jianhao, et autres
Publié: (2025)

Exponential Convergence of (Stochastic) Gradient Descent for Separable Logistic Regression
par: Kale, Sacchit, et autres
Publié: (2026)

Implicit Regularization for Tubal Tensor Factorizations via Gradient Descent
par: Karnik, Santhosh, et autres
Publié: (2024)

Gradient Descent as a Shrinkage Operator for Spectral Bias
par: Lucey, Simon
Publié: (2025)

Bias of Stochastic Gradient Descent or the Architecture: Disentangling the Effects of Overparameterization of Neural Networks
par: Peleg, Amit, et autres
Publié: (2024)

Refining Covariance Matrix Estimation in Stochastic Gradient Descent Through Bias Reduction
par: Wei, Ziyang, et autres
Publié: (2026)

Convergence of Implicit Gradient Descent for Training Two-Layer Physics-Informed Neural Networks
par: Xu, Xianliang, et autres
Publié: (2024)

Stochastic Gradient Descent with Adaptive Data
par: Che, Ethan, et autres
Publié: (2024)

Gradient Descent as a Perceptron Algorithm: Understanding Dynamics and Implicit Acceleration
par: Tyurin, Alexander
Publié: (2025)

Using Stochastic Gradient Descent to Smooth Nonconvex Functions: Analysis of Implicit Graduated Optimization
par: Sato, Naoki, et autres
Publié: (2023)

Multiclass ROC
par: Wang, Liang, et autres
Publié: (2024)

Occam Gradient Descent
par: Kausik, B. N.
Publié: (2024)

How Uniform Random Weights Induce Non-uniform Bias: Typical Interpolating Neural Networks Generalize with Narrow Teachers
par: Buzaglo, Gon, et autres
Publié: (2024)

Gradient Descent Algorithm Survey
par: Fucheng, Deng, et autres
Publié: (2025)

Are Transformers Able to Reason by Connecting Separated Knowledge in Training Data?
par: Yin, Yutong, et autres
Publié: (2025)

Implicit Bias of Per-sample Adam on Separable Data: Departure from the Full-batch Regime
par: Baek, Beomhan, et autres
Publié: (2025)

Estimation of Toeplitz Covariance Matrices using Overparameterized Gradient Descent
par: Busbib, Daniel, et autres
Publié: (2025)

Inductive Gradient Adjustment For Spectral Bias In Implicit Neural Representations
par: Shi, Kexuan, et autres
Publié: (2024)

Stacking as Accelerated Gradient Descent
par: Agarwal, Naman, et autres
Publié: (2024)

Adjacent Leader Decentralized Stochastic Gradient Descent
par: He, Haoze, et autres
Publié: (2024)