Initialization of Large Language Models via Reparameterization to Mitigate Loss Spikes

Documenti analoghi

• Debiasing Reward Models via Causally Motivated Inference-Time Intervention
  di: Shinoda, Kazutoshi, et al.
  Pubblicazione: (2026)
• Wavelet-based Positional Representation for Long Context
  di: Oka, Yui, et al.
  Pubblicazione: (2025)
• Can LLMs Detect Their Own Hallucinations?
  di: Kadotani, Sora, et al.
  Pubblicazione: (2025)
• InstructDoc: A Dataset for Zero-Shot Generalization of Visual Document Understanding with Instructions
  di: Tanaka, Ryota, et al.
  Pubblicazione: (2024)
• Let's Put Ourselves in Sally's Shoes: Shoes-of-Others Prefilling Improves Theory of Mind in Large Language Models
  di: Shinoda, Kazutoshi, et al.
  Pubblicazione: (2025)