YaRN: Efficient Context Window Extension of Large Language Models

Documenti analoghi

• Sliding Window Attention Training for Efficient Large Language Models
  di: Fu, Zichuan, et al.
  Pubblicazione: (2025)
• From 128K to 4M: Efficient Training of Ultra-Long Context Large Language Models
  di: Xu, Chejian, et al.
  Pubblicazione: (2025)
• Training-Free Exponential Context Extension via Cascading KV Cache
  di: Willette, Jeffrey, et al.
  Pubblicazione: (2024)
• EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
  di: Chen, Mengzhao, et al.
  Pubblicazione: (2024)
• Scalable Efficient Training of Large Language Models with Low-dimensional Projected Attention
  di: Lv, Xingtai, et al.
  Pubblicazione: (2024)