PTPP-Aware Adaptation Scaling Laws: Predicting Domain-Adaptation Performance at Unseen Pre-Training Budgets

Documenti analoghi

• Scaling with Collapse: Efficient and Predictable Training of LLM Families
  di: Bergsma, Shane, et al.
  Pubblicazione: (2025)
• Power Lines: Scaling Laws for Weight Decay and Batch Size in LLM Pre-training
  di: Bergsma, Shane, et al.
  Pubblicazione: (2025)
• Bilingual Adaptation of Monolingual Foundation Models
  di: Gosal, Gurpreet, et al.
  Pubblicazione: (2024)
• Straight to Zero: Why Linearly Decaying the Learning Rate to Zero Works Best for LLMs
  di: Bergsma, Shane, et al.
  Pubblicazione: (2025)
• YaPO: Learnable Sparse Activation Steering Vectors for Domain Adaptation
  di: Bounhar, Abdelaziz, et al.
  Pubblicazione: (2026)