Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark

Documenti analoghi

• Powering Up Zeroth-Order Training via Subspace Gradient Orthogonalization
  di: Lang, Yicheng, et al.
  Pubblicazione: (2026)
• DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training
  di: Chen, Aochuan, et al.
  Pubblicazione: (2023)
• One Token Embedding Is Enough to Deadlock Your Large Reasoning Model
  di: Zhang, Mohan, et al.
  Pubblicazione: (2025)
• Zeroth-Order Fine-Tuning of LLMs with Extreme Sparsity
  di: Guo, Wentao, et al.
  Pubblicazione: (2024)
• A Note on the Convergence of Muon
  di: Li, Jiaxiang, et al.
  Pubblicazione: (2025)