Sub-Scaling Laws: On the Role of Data Density and Training Strategies in LLMs

Documenti analoghi

• Scaling and Transferability of Annealing Strategies in Large Language Model Training
  di: Wang, Siqi, et al.
  Pubblicazione: (2025)
• Scaling Laws Across Model Architectures: A Comparative Analysis of Dense and MoE Models in Large Language Models
  di: Wang, Siqi, et al.
  Pubblicazione: (2024)
• SpanNorm: Reconciling Training Stability and Performance in Deep Transformers
  di: Wang, Chao, et al.
  Pubblicazione: (2026)
• What Makes Quantization for Large Language Models Hard? An Empirical Study from the Lens of Perturbation
  di: Gong, Zhuocheng, et al.
  Pubblicazione: (2024)
• In-Context Sharpness as Alerts: An Inner Representation Perspective for Hallucination Mitigation
  di: Chen, Shiqi, et al.
  Pubblicazione: (2024)