Scaling Context, Not Parameters: Training a Compact 7B Language Model for Efficient Long-Context Processing

Documenti analoghi

• How to Train Long-Context Language Models (Effectively)
  di: Gao, Tianyu, et al.
  Pubblicazione: (2024)
• PERK: Long-Context Reasoning as Parameter-Efficient Test-Time Learning
  di: Chen, Zeming, et al.
  Pubblicazione: (2025)
• HMT: Hierarchical Memory Transformer for Efficient Long Context Language Processing
  di: He, Zifan, et al.
  Pubblicazione: (2024)
• Core Context Aware Transformers for Long Context Language Modeling
  di: Chen, Yaofo, et al.
  Pubblicazione: (2024)
• LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models
  di: Chen, Yukang, et al.
  Pubblicazione: (2023)