A Minimalist Example of Edge-of-Stability and Progressive Sharpening

Documenti analoghi

• BackPlay: Head-Only Look-Back Self-Correction for Diffusion Language Models
  di: Liu, Liming, et al.
  Pubblicazione: (2026)
• COSMOS: A Hybrid Adaptive Optimizer for Memory-Efficient Training of LLMs
  di: Liu, Liming, et al.
  Pubblicazione: (2025)
• On the Interplay Between Stepsize Tuning and Progressive Sharpening
  di: Roulet, Vincent, et al.
  Pubblicazione: (2023)
• Understanding Sharpness Dynamics in NN Training with a Minimalist Example: The Effects of Dataset Difficulty, Depth, Stochasticity, and More
  di: Yoo, Geonhui, et al.
  Pubblicazione: (2025)
• Diffusion Model for Manifold Data: Score Decomposition, Curvature, and Statistical Complexity
  di: Zhang, Zixuan, et al.
  Pubblicazione: (2026)