ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization

Documenti analoghi

• ShiftAddViT: Mixture of Multiplication Primitives Towards Efficient Vision Transformer
  di: You, Haoran, et al.
  Pubblicazione: (2023)
• ShiftAddNAS: Hardware-Inspired Search for More Accurate and Efficient Neural Networks
  di: You, Haoran, et al.
  Pubblicazione: (2022)
• When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models
  di: You, Haoran, et al.
  Pubblicazione: (2024)
• ShiftAddNet: A Hardware-Inspired Deep Network
  di: You, Haoran, et al.
  Pubblicazione: (2020)
• ShiftAddAug: Augment Multiplication-Free Tiny Neural Network with Hybrid Computation
  di: Guo, Yipin, et al.
  Pubblicazione: (2024)