$μ$nit Scaling: Simple and Scalable FP8 LLM Training

Documenti analoghi

• FlashOptim: Optimizers for Memory-Efficient Training
  di: Ortiz, Jose Javier Gonzalez, et al.
  Pubblicazione: (2026)
• Towards Fully FP8 GEMM LLM Training at Scale
  di: Hernández-Cano, Alejandro, et al.
  Pubblicazione: (2025)
• MOSS: Efficient and Accurate FP8 LLM Training with Microscaling and Automatic Scaling
  di: Zhang, Yu, et al.
  Pubblicazione: (2025)
• To FP8 and Back Again: Quantifying Reduced Precision Effects on LLM Training Stability
  di: Lee, Joonhyung, et al.
  Pubblicazione: (2024)
• An Inquiry into Datacenter TCO for LLM Inference with FP8
  di: Kim, Jiwoo, et al.
  Pubblicazione: (2025)