Untie the Knots: An Efficient Data Augmentation Strategy for Long-Context Pre-Training in Language Models

Documenti analoghi

• NExtLong: Toward Effective Long-Context Training without Long Documents
  di: Gao, Chaochen, et al.
  Pubblicazione: (2025)
• LiteLong: Resource-Efficient Long-Context Data Synthesis for LLMs
  di: Jia, Junlong, et al.
  Pubblicazione: (2025)
• EntropyLong: Effective Long-Context Training via Predictive Uncertainty
  di: Jia, Junlong, et al.
  Pubblicazione: (2025)
• LongSkywork: A Training Recipe for Efficiently Extending Context Length in Large Language Models
  di: Zhao, Liang, et al.
  Pubblicazione: (2024)
• LooGLE: Can Long-Context Language Models Understand Long Contexts?
  di: Li, Jiaqi, et al.
  Pubblicazione: (2023)