Surge Phenomenon in Optimal Learning Rate and Batch Size Scaling

Documenti analoghi

• MEMO: Fine-grained Tensor Management For Ultra-long Context LLM Training
  di: Zhao, Pinxue, et al.
  Pubblicazione: (2024)
• BeamVQ: Aligning Space-Time Forecasting Model via Self-training on Physics-aware Metrics
  di: Wu, Hao, et al.
  Pubblicazione: (2024)
• BeamVQ: Beam Search with Vector Quantization to Mitigate Data Scarcity in Physical Spatiotemporal Forecasting
  di: Wang, Weiyan, et al.
  Pubblicazione: (2025)
• Scaling Laws for Floating Point Quantization Training
  di: Sun, Xingwu, et al.
  Pubblicazione: (2025)
• Learning from History: A Retrieval-Augmented Framework for Spatiotemporal Prediction
  di: Jia, Hao, et al.
  Pubblicazione: (2025)