Adaptive Methods through the Lens of SDEs: Theoretical Insights on the Role of Noise

Documenti analoghi

• Unbiased and Sign Compression in Distributed Learning: Comparing Noise Resilience via SDEs
  di: Compagnoni, Enea Monzio, et al.
  Pubblicazione: (2025)
• On the Interaction of Batch Noise, Adaptivity, and Compression, under $(L_0,L_1)$-Smoothness: An SDE Approach
  di: Compagnoni, Enea Monzio, et al.
  Pubblicazione: (2025)
• SDEs for Minimax Optimization
  di: Compagnoni, Enea Monzio, et al.
  Pubblicazione: (2024)
• Adaptive Methods Are Preferable in High Privacy Settings: An SDE Perspective
  di: Compagnoni, Enea Monzio, et al.
  Pubblicazione: (2026)
• Loss Landscape Characterization of Neural Networks without Over-Parametrization
  di: Islamov, Rustem, et al.
  Pubblicazione: (2024)