Guardado en:
| Autores principales: | Tsilivis, Nikolaos, Gronich, Eitan, Kempe, Julia, Vardi, Gal |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | https://arxiv.org/abs/2410.22069 |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
The Implicit Bias of Adam and Muon on Smooth Homogeneous Neural Networks
por: Gronich, Eitan, et al.
Publicado: (2026)
por: Gronich, Eitan, et al.
Publicado: (2026)
The Price of Implicit Bias in Adversarially Robust Generalization
por: Tsilivis, Nikolaos, et al.
Publicado: (2024)
por: Tsilivis, Nikolaos, et al.
Publicado: (2024)
On the Robustness of Neural Collapse and the Neural Collapse of Robustness
por: Su, Jingtong, et al.
Publicado: (2023)
por: Su, Jingtong, et al.
Publicado: (2023)
Attacking Bayes: On the Adversarial Robustness of Bayesian Neural Networks
por: Feng, Yunzhen, et al.
Publicado: (2024)
por: Feng, Yunzhen, et al.
Publicado: (2024)
How Reinforcement Learning After Next-Token Prediction Facilitates Learning
por: Tsilivis, Nikolaos, et al.
Publicado: (2025)
por: Tsilivis, Nikolaos, et al.
Publicado: (2025)
Learning to Think from Multiple Thinkers
por: Joshi, Nirmit, et al.
Publicado: (2026)
por: Joshi, Nirmit, et al.
Publicado: (2026)
On the Geometry of Regularization in Adversarial Training: High-Dimensional Asymptotics and Generalization Bounds
por: Vilucchio, Matteo, et al.
Publicado: (2024)
por: Vilucchio, Matteo, et al.
Publicado: (2024)
The Implicit Bias of Steepest Descent with Mini-batch Stochastic Gradient
por: Li, Jichu, et al.
Publicado: (2026)
por: Li, Jichu, et al.
Publicado: (2026)
Implicit Regularization Towards Rank Minimization in ReLU Networks
por: Timor, Nadav, et al.
Publicado: (2022)
por: Timor, Nadav, et al.
Publicado: (2022)
Implicit Bias of Gradient Descent for Non-Homogeneous Deep Networks
por: Cai, Yuhang, et al.
Publicado: (2025)
por: Cai, Yuhang, et al.
Publicado: (2025)
ImpMIA: Leveraging Implicit Bias for Membership Inference Attack
por: Golbari, Yuval, et al.
Publicado: (2025)
por: Golbari, Yuval, et al.
Publicado: (2025)
Provable Privacy Attacks on Trained Shallow Neural Networks
por: Smorodinsky, Guy, et al.
Publicado: (2024)
por: Smorodinsky, Guy, et al.
Publicado: (2024)
Faster Acceleration for Steepest Descent
por: Bai, Cedar Site, et al.
Publicado: (2024)
por: Bai, Cedar Site, et al.
Publicado: (2024)
Provable Unlearning with Gradient Ascent on Two-Layer ReLU Neural Networks
por: Melamed, Odelia, et al.
Publicado: (2025)
por: Melamed, Odelia, et al.
Publicado: (2025)
Noisy Interpolation Learning with Shallow Univariate ReLU Networks
por: Joshi, Nirmit, et al.
Publicado: (2023)
por: Joshi, Nirmit, et al.
Publicado: (2023)
Trained Transformer Classifiers Generalize and Exhibit Benign Overfitting In-Context
por: Frei, Spencer, et al.
Publicado: (2024)
por: Frei, Spencer, et al.
Publicado: (2024)
Transformers are almost optimal metalearners for linear classification
por: Magen, Roey, et al.
Publicado: (2025)
por: Magen, Roey, et al.
Publicado: (2025)
Never Saddle for Reparameterized Steepest Descent as Mirror Flow
por: Jacobs, Tom, et al.
Publicado: (2026)
por: Jacobs, Tom, et al.
Publicado: (2026)
Feature Averaging: An Implicit Bias of Gradient Descent Leading to Non-Robustness in Neural Networks
por: Li, Binghui, et al.
Publicado: (2024)
por: Li, Binghui, et al.
Publicado: (2024)
Implicit Bias of Mirror Flow in Homogeneous Neural Networks: Sparse and Dense Feature Learning
por: Jacobs, Tom, et al.
Publicado: (2026)
por: Jacobs, Tom, et al.
Publicado: (2026)
Querying Kernel Methods Suffices for Reconstructing their Training Data
por: Barzilai, Daniel, et al.
Publicado: (2025)
por: Barzilai, Daniel, et al.
Publicado: (2025)
Deconstructing the Goldilocks Zone of Neural Network Initialization
por: Vysogorets, Artem, et al.
Publicado: (2024)
por: Vysogorets, Artem, et al.
Publicado: (2024)
The Implicit Bias of Gradient Descent on Separable Data
por: Soudry, Daniel, et al.
Publicado: (2017)
por: Soudry, Daniel, et al.
Publicado: (2017)
Convergence of Steepest Descent and Adam under Non-Uniform Smoothness
por: Vaswani, Sharan, et al.
Publicado: (2026)
por: Vaswani, Sharan, et al.
Publicado: (2026)
Overfitting Behaviour of Gaussian Kernel Ridgeless Regression: Varying Bandwidth or Dimensionality
por: Medvedev, Marko, et al.
Publicado: (2024)
por: Medvedev, Marko, et al.
Publicado: (2024)
To Grok Grokking: Provable Grokking in Ridge Regression
por: Xu, Mingyue, et al.
Publicado: (2026)
por: Xu, Mingyue, et al.
Publicado: (2026)
Generalization Bounds of Stochastic Gradient Descent in Homogeneous Neural Networks
por: Ma, Wenquan, et al.
Publicado: (2026)
por: Ma, Wenquan, et al.
Publicado: (2026)
SPGD: Steepest Perturbed Gradient Descent Optimization
por: Vahedi, Amir M., et al.
Publicado: (2024)
por: Vahedi, Amir M., et al.
Publicado: (2024)
The Implicit Bias of Gradient Descent on Separable Multiclass Data
por: Ravi, Hrithik, et al.
Publicado: (2024)
por: Ravi, Hrithik, et al.
Publicado: (2024)
Implicit Bias and Convergence of Matrix Stochastic Mirror Descent
por: Akhtiamov, Danil, et al.
Publicado: (2026)
por: Akhtiamov, Danil, et al.
Publicado: (2026)
The Evolution of Statistical Induction Heads: In-Context Learning Markov Chains
por: Edelman, Benjamin L., et al.
Publicado: (2024)
por: Edelman, Benjamin L., et al.
Publicado: (2024)
Large Stepsize Gradient Descent for Non-Homogeneous Two-Layer Networks: Margin Improvement and Fast Optimization
por: Cai, Yuhang, et al.
Publicado: (2024)
por: Cai, Yuhang, et al.
Publicado: (2024)
Stacey: Promoting Stochastic Steepest Descent via Accelerated $\ell_p$-Smooth Nonconvex Optimization
por: Luo, Xinyu, et al.
Publicado: (2025)
por: Luo, Xinyu, et al.
Publicado: (2025)
How Does the ReLU Activation Affect the Implicit Bias of Gradient Descent on High-dimensional Neural Network Regression?
por: Lai, Kuo-Wei, et al.
Publicado: (2026)
por: Lai, Kuo-Wei, et al.
Publicado: (2026)
Preconditioned Norms: A Unified Framework for Steepest Descent, Quasi-Newton and Adaptive Methods
por: Veprikov, Andrey, et al.
Publicado: (2025)
por: Veprikov, Andrey, et al.
Publicado: (2025)
Implicit Bias of Spectral Descent and Muon on Multiclass Separable Data
por: Fan, Chen, et al.
Publicado: (2025)
por: Fan, Chen, et al.
Publicado: (2025)
Convergence and Implicit Bias of Gradient Descent on Continual Linear Classification
por: Jung, Hyunji, et al.
Publicado: (2025)
por: Jung, Hyunji, et al.
Publicado: (2025)
Beyond Implicit Bias: The Insignificance of SGD Noise in Online Learning
por: Vyas, Nikhil, et al.
Publicado: (2023)
por: Vyas, Nikhil, et al.
Publicado: (2023)
On the Hardness of Learning Regular Expressions
por: Attias, Idan, et al.
Publicado: (2025)
por: Attias, Idan, et al.
Publicado: (2025)
An Agnostic View on the Cost of Overfitting in (Kernel) Ridge Regression
por: Zhou, Lijia, et al.
Publicado: (2023)
por: Zhou, Lijia, et al.
Publicado: (2023)
Ejemplares similares
-
The Implicit Bias of Adam and Muon on Smooth Homogeneous Neural Networks
por: Gronich, Eitan, et al.
Publicado: (2026) -
The Price of Implicit Bias in Adversarially Robust Generalization
por: Tsilivis, Nikolaos, et al.
Publicado: (2024) -
On the Robustness of Neural Collapse and the Neural Collapse of Robustness
por: Su, Jingtong, et al.
Publicado: (2023) -
Attacking Bayes: On the Adversarial Robustness of Bayesian Neural Networks
por: Feng, Yunzhen, et al.
Publicado: (2024) -
How Reinforcement Learning After Next-Token Prediction Facilitates Learning
por: Tsilivis, Nikolaos, et al.
Publicado: (2025)