Noise Balance and Stationary Distribution of Stochastic Gradient Descent

Documenti analoghi

• Parameter Symmetry and Noise Equilibrium of Stochastic Gradient Descent
  di: Ziyin, Liu, et al.
  Pubblicazione: (2024)
• Type-II Saddles and Probabilistic Stability of Stochastic Gradient Descent
  di: Ziyin, Liu, et al.
  Pubblicazione: (2023)
• Stochastic Re-weighted Gradient Descent via Distributionally Robust Optimization
  di: Kumar, Ramnath, et al.
  Pubblicazione: (2023)
• Trustworthiness of Stochastic Gradient Descent in Distributed Learning
  di: Li, Hongyang, et al.
  Pubblicazione: (2024)
• Adaptive Batch Sizes Using Non-Euclidean Gradient Noise Scales for Stochastic Sign and Spectral Descent
  di: Naganuma, Hiroki, et al.
  Pubblicazione: (2026)