On the Convergence Behavior of Preconditioned Gradient Descent Toward the Rich Learning Regime

Documenti analoghi

• Kourkoutas-Beta: A Sunspike-Driven Adam Optimizer with Desert Flair
  di: Kassinos, Stavros C.
  Pubblicazione: (2025)
• Local properties of neural networks through the lens of layer-wise Hessians
  di: Bolshim, Maxim, et al.
  Pubblicazione: (2025)
• ZetA: A Riemann Zeta-Scaled Extension of Adam for Deep Learning
  di: BC, Samiksha
  Pubblicazione: (2025)
• Inter-Layer Hessian Analysis of Neural Networks with DAG Architectures
  di: Bolshim, Maxim, et al.
  Pubblicazione: (2026)
• Stochastic Estimation of the Layer-wise Hessian Trace for Monitoring Neural-network Training
  di: Bolshim, Maxim, et al.
  Pubblicazione: (2026)