Accelerating Neural Network Training Along Sharp and Flat Directions

Documenti analoghi

• Some Fundamental Aspects about Lipschitz Continuity of Neural Networks
  di: Khromov, Grigory, et al.
  Pubblicazione: (2023)
• Hallmarks of Optimization Trajectories in Neural Networks: Directional Exploration and Redundancy
  di: Singh, Sidak Pal, et al.
  Pubblicazione: (2024)
• Theoretical characterisation of the Gauss-Newton conditioning in Neural Networks
  di: Zhao, Jim, et al.
  Pubblicazione: (2024)
• What Does It Mean to Be a Transformer? Insights from a Theoretical Hessian Analysis
  di: Ormaniec, Weronika, et al.
  Pubblicazione: (2024)
• Rethinking Attention: Exploring Shallow Feed-Forward Neural Networks as an Alternative to Attention Layers in Transformers
  di: Bozic, Vukasin, et al.
  Pubblicazione: (2023)