From Spikes to Heavy Tails: Unveiling the Spectral Evolution of Neural Networks

Documenti analoghi

• HTMuon: Improving Muon via Heavy-Tailed Spectral Correction
  di: Pang, Tianyu, et al.
  Pubblicazione: (2026)
• Balancing Learning Rates Across Layers: Exact Two-Step Dynamics and Optimal Scaling in Linear Neural Networks
  di: Pang, Tianyu, et al.
  Pubblicazione: (2026)
• Can Kernel Methods Explain How the Data Affects Neural Collapse?
  di: Kothapalli, Vignesh, et al.
  Pubblicazione: (2024)
• Chemical Reaction Networks Learn Better than Spiking Neural Networks
  di: Jaffard, Sophie, et al.
  Pubblicazione: (2026)
• Neural Networks Generalize on Low Complexity Data
  di: Chatterjee, Sourav, et al.
  Pubblicazione: (2024)