:: Library Catalog

Imagen de Portada

Guardado en:

Detalles Bibliográficos
Autores principales:	Dauphin, Yann N., Agarwala, Atish, Mobahi, Hossein
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning
Acceso en línea:	https://arxiv.org/abs/2401.10809
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Avoiding spurious sharpness minimization broadens applicability of SAM
por: Singh, Sidak Pal, et al.
Publicado: (2025)

High dimensional theory of two-phase optimizers
por: Agarwala, Atish
Publicado: (2026)

Per-example gradients: a new frontier for understanding and improving optimizers
por: Roulet, Vincent, et al.
Publicado: (2025)

High dimensional analysis reveals conservative sharpening and a stochastic edge of stability
por: Agarwala, Atish, et al.
Publicado: (2024)

Feature learning as alignment: a structural property of gradient descent in non-linear neural networks
por: Beaglehole, Daniel, et al.
Publicado: (2024)

On the Interplay Between Stepsize Tuning and Progressive Sharpening
por: Roulet, Vincent, et al.
Publicado: (2023)

To Clip or not to Clip: the Dynamics of SGD with Gradient Clipping in High-Dimensions
por: Marshall, Noah, et al.
Publicado: (2024)

Exact Risk Curves of signSGD in High-Dimensions: Quantifying Preconditioning and Noise-Compression Effects
por: Xiao, Ke Liang, et al.
Publicado: (2024)

What do near-optimal learning rate schedules look like?
por: Naganuma, Hiroki, et al.
Publicado: (2026)

Scaling Collapse Reveals Universal Dynamics in Compute-Optimally Trained Neural Networks
por: Qiu, Shikai, et al.
Publicado: (2025)

Data-Aware Random Feature Kernel for Transformers
por: Farzam, Amirhossein, et al.
Publicado: (2026)

Stepping on the Edge: Curvature Aware Learning Rate Tuners
por: Roulet, Vincent, et al.
Publicado: (2024)

Phases of Muon: When Muon Eclipses SignSGD
por: Paquette, Elliot, et al.
Publicado: (2026)

On the Foundations of Shortcut Learning
por: Hermann, Katherine L., et al.
Publicado: (2023)

On student-teacher deviations in distillation: does it pay to disobey?
por: Nagarajan, Vaishnavh, et al.
Publicado: (2023)

How far away are truly hyperparameter-free learning algorithms?
por: Kasimbeg, Priya, et al.
Publicado: (2025)

Hessian-Informed Flow Matching
por: Sprague, Christopher Iliffe, et al.
Publicado: (2024)

Robustmix: Improving Robustness by Regularizing the Frequency Bias of Deep Nets
por: Ngnawe, Jonas, et al.
Publicado: (2023)

SASSHA: Sharpness-aware Adaptive Second-order Optimization with Stable Hessian Approximation
por: Shin, Dahun, et al.
Publicado: (2025)

Introduction to speech recognition
por: Dauphin, Gabriel
Publicado: (2024)

FORML: A Riemannian Hessian-free Method for Meta-learning on Stiefel Manifolds
por: Tabealhojeh, Hadi, et al.
Publicado: (2024)

Towards Optimal Adapter Placement for Efficient Transfer Learning
por: Nowak, Aleksandra I., et al.
Publicado: (2024)

A density estimation perspective on learning from pairwise human preferences
por: Dumoulin, Vincent, et al.
Publicado: (2023)

From explained variance of correlated components to PCA without orthogonality constraints
por: Chavent, Marie, et al.
Publicado: (2024)

Transformer brain encoders explain human high-level visual responses
por: Adeli, Hossein, et al.
Publicado: (2025)

A Closed-Form Persistence-Landmark Pipeline for Certified Point-Cloud and Graph Classification
por: Majhi, Sushovan, et al.
Publicado: (2026)

Task Specific Sharpness Aware O-RAN Resource Management using Multi Agent Reinforcement Learning
por: Lotfi, Fatemeh, et al.
Publicado: (2025)

Forget Sharpness: Perturbed Forgetting of Model Biases Within SAM Dynamics
por: Vani, Ankit, et al.
Publicado: (2024)

HessFormer: Hessians at Foundation Scale
por: Granziol, Diego
Publicado: (2025)

Hybrid deep convolution model for lung cancer detection with transfer learning
por: Saxena, Sugandha, et al.
Publicado: (2025)

Capturing Individual Human Preferences with Reward Features
por: Barreto, André, et al.
Publicado: (2025)

Hessian QM9: A quantum chemistry database of molecular Hessians in implicit solvents
por: Williams, Nicholas J., et al.
Publicado: (2024)

The Neglected Tails in Vision-Language Models
por: Parashar, Shubham, et al.
Publicado: (2024)

FLEXtime: Filterbank learning to explain time series
por: Brüsch, Thea, et al.
Publicado: (2024)

Amplifier: Bringing Attention to Neglected Low-Energy Components in Time Series Forecasting
por: Fei, Jingru, et al.
Publicado: (2025)

Depth, Not Data: An Analysis of Hessian Spectral Bifurcation
por: Deng, Shenyang, et al.
Publicado: (2026)

Hessian Spectral Analysis at Foundation Model Scale
por: Granziol, Diego, et al.
Publicado: (2026)

The Hessian of tall-skinny networks is easy to invert
por: Rahimi, Ali
Publicado: (2026)

Topological Characterization of Churn Flow and Unsupervised Correction to the Wu Flow-Regime Map in Small-Diameter Vertical Pipes
por: Koenig, Brady, et al.
Publicado: (2026)

The Surprising Benefits of Base Rate Neglect in Robust Aggregation
por: Kong, Yuqing, et al.
Publicado: (2024)