Cover Image

Benchmarking Neural Network Training Algorithms

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Dahl, George E., Schneider, Frank, Nado, Zachary, Agarwal, Naman, Sastry, Chandramouli Shama, Hennig, Philipp, Medapati, Sourabh, Eschenhagen, Runa, Kasimbeg, Priya, Suo, Daniel, Bae, Juhan, Gilmer, Justin, Peirson, Abel L., Khan, Bilal, Anil, Rohan, Rabbat, Mike, Krishnan, Shankar, Snider, Daniel, Amid, Ehsan, Chen, Kongtao, Maddison, Chris J., Vasudev, Rakshith, Badura, Michal, Garg, Ankush, Mattson, Peter
Format:	Preprint
Published:	2023
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Accelerating Neural Network Training: An Analysis of the AlgoPerf Competition
by: Kasimbeg, Priya, et al.
Published: (2025)

Training neural networks faster with minimal tuning using pre-computed lists of hyperparameters for NAdamW
by: Medapati, Sourabh, et al.
Published: (2025)

Adaptive Gradient Methods at the Edge of Stability
by: Cohen, Jeremy M., et al.
Published: (2022)

How far away are truly hyperparameter-free learning algorithms?
by: Kasimbeg, Priya, et al.
Published: (2025)

Influence Functions for Scalable Data Attribution in Diffusion Models
by: Mlodozeniec, Bruno, et al.
Published: (2024)

Kronecker-Factored Approximate Curvature for Modern Neural Network Architectures
by: Eschenhagen, Runa, et al.
Published: (2023)

Test-Time Training for Depression Detection
by: Dumpala, Sri Harsha, et al.
Published: (2024)

Can We Remove the Square-Root in Adaptive Gradient Methods? A Second-Order Perspective
by: Lin, Wu, et al.
Published: (2024)

Spectral-factorized Positive-definite Curvature Learning for NN Training
by: Lin, Wu, et al.
Published: (2025)

Better Hessians Matter: Studying the Impact of Curvature Approximations in Influence Functions
by: Hong, Steve, et al.
Published: (2025)

Kronecker-factored Approximate Curvature (KFAC) From Scratch
by: Dangel, Felix, et al.
Published: (2025)

Accurate Failure Prediction in Agents Does Not Imply Effective Failure Prevention
by: Vasudev, Rakshith, et al.
Published: (2026)

DiffAug: A Diffuse-and-Denoise Augmentation for Training Robust Classifiers
by: Sastry, Chandramouli, et al.
Published: (2023)

Analyticup E-commerce Product Search Competition Technical Report from Team Tredence_AICOE
by: R, Rakshith, et al.
Published: (2025)

Learning by solving differential equations
by: Dherin, Benoit, et al.
Published: (2025)

EXAMINING LOCAL SOCIAL IDENTITIES THROUGH PATTERNS OF BIOLOGICAL AND CULTURAL VARIATION IN THE SOLCOR AYLLU, SAN PEDRO DE ATACAMA, CHILE
by: Kristin L. Nado
Published: (2012)

Clarifying Shampoo: Adapting Spectral Descent to Stochasticity and the Parameter Trajectory
by: Eschenhagen, Runa, et al.
Published: (2026)

Position: Curvature Matrices Should Be Democratized via Linear Operators
by: Dangel, Felix, et al.
Published: (2025)

Swarming behaviour associated with group cohesion in tree-dwelling bats
by: Naďo, Ladislav, et al.
Published: (2015)

Pre-trained Gaussian Processes for Bayesian Optimization
by: Wang, Zi, et al.
Published: (2021)

Purifying Shampoo: Investigating Shampoo's Heuristics by Decomposing its Preconditioner
by: Eschenhagen, Runa, et al.
Published: (2025)

Understanding and Improving Shampoo and SOAP via Kullback-Leibler Minimization
by: Lin, Wu, et al.
Published: (2025)

Falencias metodológicas y estadísticas en la valoración diagnóstica imagenológica: Precisiones y recomendaciones
by: Gilmer Solis
Published: (2020)

Towards flexible perception with visual memory
by: Geirhos, Robert, et al.
Published: (2024)

Representation Alignment from Human Feedback for Cross-Embodiment Reward Learning from Mixed-Quality Demonstrations
by: Mattson, Connor, et al.
Published: (2024)

La educación ambiental superior en América Latina: una evaluación de la oferta de posgrados ambientales
by: María Luisa Eschenhagen
Published: (2007)

RETOS EPISTEMOLÓGICOS Y TEÓRICOS PARA EL CURRICULUM AMBIENTAL DE POSGRADOS
by: María Luisa Eschenhagen
Published: (2008)

Vivir bien frente al desarollo, procesos de planeación participativa en Medellín
by: María Luisa Eschenhagen
Published: (2012)

Contexto y exigencias a las ciencias sociales, para afrontar los problemas ambientales
by: María Luisa Eschenhagen
Published: (2011)

Tres ejes de diálogo epistemológico para aproximarse a una interpretación de la relación ser humano-naturaleza
by: Maria Luisa Eschenhagen
Published: (2017)

Los límites de la retórica verde o ¿Porqué después de más de 30 años de esfuerzos no se observan mejoras ambientales sustanciales?
by: María Luisa Eschenhagen
Published: (2010)

Colonialidad del saber en la educación ambiental: la necesidad de diálogos de Saberes
by: María Luisa Eschenhagen
Published: (2021)

Desafíos para pensar desde la vida en las ciencias sociales
by: María Luisa Eschenhagen
Published: (2015)

Las cumbres ambientales internacionales y la educación ambiental
by: María Luisa Eschenhagen
Published: (2007)

DIVERSAS CONSIDERACIONES Y APROXIMACIONES A LA NOCIÓN DE COMPLEJIDAD AMBIENTAL
by: María Luisa Eschenhagen
Published: (2007)

Structured Inverse-Free Natural Gradient: Memory-Efficient & Numerically-Stable KFAC
by: Lin, Wu, et al.
Published: (2023)

Symmetry Breaking in Transformers for Efficient and Interpretable Training
by: Silverstein, Eva, et al.
Published: (2026)

Self-Supervised Convolutional Audio Models are Flexible Acoustic Feature Learners: A Domain Specificity and Transfer-Learning Study
by: Ogg, Mattson
Published: (2025)

Measurement of Transverse Single-Spin Asymmetries in $π^0$ and $η$ Meson Production in $\sqrt{s}$ = 200 GeV $p^\uparrow+p$ Collisions with sPHENIX
by: Mattson, Gregory
Published: (2025)

Evaluation of external anchor tags for estimation of growth and survival in tilapia (Oreochromis shiranus chilwae Trewavas)
by: Mattson, N.S.
Published: (1995)