Densing Law of LLMs

Documenti analoghi

• Exploring the Benefit of Activation Sparsity in Pre-training
  di: Zhang, Zhengyan, et al.
  Pubblicazione: (2024)
• InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memory
  di: Xiao, Chaojun, et al.
  Pubblicazione: (2024)
• H-Neurons: On the Existence, Impact, and Origin of Hallucination-Associated Neurons in LLMs
  di: Gao, Cheng, et al.
  Pubblicazione: (2025)
• InfLLM-V2: Dense-Sparse Switchable Attention for Seamless Short-to-Long Adaptation
  di: Zhao, Weilin, et al.
  Pubblicazione: (2025)
• Data Science and Technology Towards AGI Part I: Tiered Data Management
  di: Wang, Yudong, et al.
  Pubblicazione: (2026)