ZO2: Scalable Zeroth-Order Fine-Tuning for Extremely Large Language Models with Limited GPU Memory

Documenti analoghi

• DistZO2: High-Throughput and Memory-Efficient Zeroth-Order Fine-tuning LLMs with Distributed Parallel Computing
  di: Wang, Liangyu, et al.
  Pubblicazione: (2025)
• QuZO: Quantized Zeroth-Order Fine-Tuning for Large Language Models
  di: Zhou, Jiajun, et al.
  Pubblicazione: (2025)
• GPU-Accelerated Parallel Selected Inversion for Structured Matrices Using sTiles
  di: Fattah, Esmail Abdul, et al.
  Pubblicazione: (2025)
• FlashDP: Private Training Large Language Models with Efficient DP-SGD
  di: Wang, Liangyu, et al.
  Pubblicazione: (2025)
• ZO-ASR: Zeroth-Order Fine-Tuning of Speech Foundation Models without Back-Propagation
  di: Peng, Yuezhang, et al.
  Pubblicazione: (2025)