Stepping on the Edge: Curvature Aware Learning Rate Tuners

Documenti analoghi

• On the Interplay Between Stepsize Tuning and Progressive Sharpening
  di: Roulet, Vincent, et al.
  Pubblicazione: (2023)
• Per-example gradients: a new frontier for understanding and improving optimizers
  di: Roulet, Vincent, et al.
  Pubblicazione: (2025)
• How far away are truly hyperparameter-free learning algorithms?
  di: Kasimbeg, Priya, et al.
  Pubblicazione: (2025)
• The Elements of Differentiable Programming
  di: Blondel, Mathieu, et al.
  Pubblicazione: (2024)
• High dimensional theory of two-phase optimizers
  di: Agarwala, Atish
  Pubblicazione: (2026)