Can Stationary Distributions of Scale-Invariant Neural Networks Be Described by the Thermodynamics of an Ideal Gas?

Documenti analoghi

• SGD as Free Energy Minimization: A Thermodynamic View on Neural Network Training
  di: Sadrtdinov, Ildus, et al.
  Pubblicazione: (2025)
• To Stay or Not to Stay in the Pre-train Basin: Insights on Ensembling in Transfer Learning
  di: Sadrtdinov, Ildus, et al.
  Pubblicazione: (2023)
• Where Do Large Learning Rates Lead Us?
  di: Sadrtdinov, Ildus, et al.
  Pubblicazione: (2024)
• Loss Patterns of Neural Networks
  di: Skorokhodov, Ivan, et al.
  Pubblicazione: (2019)
• Why Gaussian Diffusion Models Fail on Discrete Data and How to Prevent It?
  di: Shabalin, Alexander, et al.
  Pubblicazione: (2026)