Uncovering Symmetry Transfer in Large Language Models via Layer-Peeled Optimization

Documenti analoghi

• The Newton-Muon Optimizer
  di: Du, Zhehang, et al.
  Pubblicazione: (2026)
• Isotropic Curvature Model for Understanding Deep Learning Optimization: Is Gradient Orthogonalization Optimal?
  di: Su, Weijie
  Pubblicazione: (2025)
• Symmetry-Compatible Principle for Optimizer Design: Embeddings, LM Heads, SwiGLU MLPs, and MoE Routers
  di: Lau, Tim Tsz-Kit, et al.
  Pubblicazione: (2026)
• Robust Learning Rate Selection for Stochastic Optimization via Splitting Diagnostic
  di: Sordello, Matteo, et al.
  Pubblicazione: (2019)
• Reward Collapse in Aligning Large Language Models
  di: Song, Ziang, et al.
  Pubblicazione: (2023)