Documenti analoghi

• Perplexity-Aware Data Scaling Law: Perplexity Landscapes Predict Performance for Continual Pre-training
  di: Liu, Lei, et al.
  Pubblicazione: (2025)
• Scaling Laws for Upcycling Mixture-of-Experts Language Models
  di: Liew, Seng Pei, et al.
  Pubblicazione: (2025)
• Lory: Fully Differentiable Mixture-of-Experts for Autoregressive Language Model Pre-training
  di: Zhong, Zexuan, et al.
  Pubblicazione: (2024)
• Making Pre-trained Language Models Great on Tabular Prediction
  di: Yan, Jiahuan, et al.
  Pubblicazione: (2024)
• Investigating Data Contamination for Pre-training Language Models
  di: Jiang, Minhao, et al.
  Pubblicazione: (2024)