When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models

Documenti analoghi

• ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization
  di: You, Haoran, et al.
  Pubblicazione: (2024)
• ShiftAddNAS: Hardware-Inspired Search for More Accurate and Efficient Neural Networks
  di: You, Haoran, et al.
  Pubblicazione: (2022)
• Efficient-DLM: From Autoregressive to Diffusion Language Models, and Beyond in Speed
  di: Fu, Yonggan, et al.
  Pubblicazione: (2025)
• LaCache: Ladder-Shaped KV Caching for Efficient Long-Context Modeling of Large Language Models
  di: Shi, Dachuan, et al.
  Pubblicazione: (2025)
• ShiftAddViT: Mixture of Multiplication Primitives Towards Efficient Vision Transformer
  di: You, Haoran, et al.
  Pubblicazione: (2023)