Enhancing Zeroth-order Fine-tuning for Language Models with Low-rank Structures

Documenti analoghi

• A Memory Efficient Randomized Subspace Optimization Method for Training Large Language Models
  di: Chen, Yiming, et al.
  Pubblicazione: (2025)
• Private Fine-tuning of Large Language Models with Zeroth-order Optimization
  di: Tang, Xinyu, et al.
  Pubblicazione: (2024)
• Harmony in Divergence: Towards Fast, Accurate, and Memory-efficient Zeroth-order LLM Fine-tuning
  di: Tan, Qitao, et al.
  Pubblicazione: (2025)
• Fine-tuning Quantized Neural Networks with Zeroth-order Optimization
  di: Shang, Sifeng, et al.
  Pubblicazione: (2025)
• Towards Fast LLM Fine-tuning through Zeroth-Order Optimization with Projected Gradient-Aligned Perturbations
  di: Mi, Zhendong, et al.
  Pubblicazione: (2025)