Documenti analoghi

• Inner Thinking Transformer: Leveraging Dynamic Depth Scaling to Foster Adaptive Internal Thinking
  di: Chen, Yilong, et al.
  Pubblicazione: (2025)
• Mixture of Hidden-Dimensions Transformer
  di: Chen, Yilong, et al.
  Pubblicazione: (2024)
• Elastic MoE: Unlocking the Inference-Time Scalability of Mixture-of-Experts
  di: Gu, Naibin, et al.
  Pubblicazione: (2025)
• DHA: Learning Decoupled-Head Attention from Transformer Checkpoints via Adaptive Heads Fusion
  di: Chen, Yilong, et al.
  Pubblicazione: (2024)
• Sparse Growing Transformer: Training-Time Sparse Depth Allocation via Progressive Attention Looping
  di: Chen, Yao, et al.
  Pubblicazione: (2026)