SWAN-GPT: An Efficient and Scalable Approach for Long-Context Language Modeling

Documenti analoghi

• RULER: What's the Real Context Size of Your Long-Context Language Models?
  di: Hsieh, Cheng-Ping, et al.
  Pubblicazione: (2024)
• L0-Reasoning Bench: Evaluating Procedural Correctness in Language Models via Simple Program Execution
  di: Sun, Simeng, et al.
  Pubblicazione: (2025)
• nGPT: Normalized Transformer with Representation Learning on the Hypersphere
  di: Loshchilov, Ilya, et al.
  Pubblicazione: (2024)
• Star Attention: Efficient LLM Inference over Long Sequences
  di: Acharya, Shantanu, et al.
  Pubblicazione: (2024)
• From Output to Evaluation: Does Raw Instruction-Tuned Code LLMs Output Suffice for Fill-in-the-Middle Code Generation?
  di: Ahmad, Wasi Uddin, et al.
  Pubblicazione: (2025)