DistZO2: High-Throughput and Memory-Efficient Zeroth-Order Fine-tuning LLMs with Distributed Parallel Computing

Documenti analoghi

• ZO2: Scalable Zeroth-Order Fine-Tuning for Extremely Large Language Models with Limited GPU Memory
  di: Wang, Liangyu, et al.
  Pubblicazione: (2025)
• TeZO: Empowering the Low-Rankness on the Temporal Dimension in the Zeroth-Order Optimization for Fine-tuning LLMs
  di: Sun, Yan, et al.
  Pubblicazione: (2025)
• A High-Throughput Compute-Efficient POMDP Hide-And-Seek-Engine (HASE) for Multi-Agent Operations
  di: Flavin, Timothy, et al.
  Pubblicazione: (2026)
• CurvZO: Adaptive Curvature-Guided Sparse Zeroth-Order Optimization for Efficient LLM Fine-Tuning
  di: Wang, Shuo, et al.
  Pubblicazione: (2026)
• ElasticZO: A Memory-Efficient On-Device Learning with Combined Zeroth- and First-Order Optimization
  di: Sugiura, Keisuke, et al.
  Pubblicazione: (2025)