Balcony: A Lightweight Approach to Dynamic Inference of Generative Language Models

Documenti analoghi

• SCOUT: Toward Sub-Quadratic Attention via Segment Compression for Optimized Utility in Transformers
  di: Jafari, Aref, et al.
  Pubblicazione: (2025)
• DTRNet: Dynamic Token Routing Network to Reduce Quadratic Costs in Transformers
  di: Sharma, Aman, et al.
  Pubblicazione: (2025)
• Sorted LLaMA: Unlocking the Potential of Intermediate Layers of Large Language Models for Dynamic Inference
  di: Kavehzadeh, Parsa, et al.
  Pubblicazione: (2023)
• SortedNet: A Scalable and Generalized Framework for Training Modular Deep Neural Networks
  di: Valipour, Mojtaba, et al.
  Pubblicazione: (2023)
• EchoAtt: Attend, Copy, then Adjust for More Efficient Large Language Models
  di: Rajabzadeh, Hossein, et al.
  Pubblicazione: (2024)