Subspace Optimization for Large Language Models with Convergence Guarantees

Documenti analoghi

• Greedy Low-Rank Gradient Compression for Distributed Learning with Convergence Guarantees
  di: Chen, Chuyan, et al.
  Pubblicazione: (2025)
• From PowerSGD to PowerSGD+: Low-Rank Gradient Compression for Distributed Optimization with Convergence Guarantees
  di: Xie, Shengping, et al.
  Pubblicazione: (2025)
• Adam-family Methods for Nonsmooth Optimization with Convergence Guarantees
  di: Xiao, Nachuan, et al.
  Pubblicazione: (2023)
• Lean and Mean Adaptive Optimization via Subset-Norm and Subspace-Momentum with Convergence Guarantees
  di: Nguyen, Thien Hang, et al.
  Pubblicazione: (2024)
• Stochastic Compositional Minimax Optimization with Provable Convergence Guarantees
  di: Deng, Yuyang, et al.
  Pubblicazione: (2024)