Sorted LLaMA: Unlocking the Potential of Intermediate Layers of Large Language Models for Dynamic Inference

Documenti analoghi

• SortedNet: A Scalable and Generalized Framework for Training Modular Deep Neural Networks
  di: Valipour, Mojtaba, et al.
  Pubblicazione: (2023)
• S2D: Sorted Speculative Decoding For More Efficient Deployment of Nested Large Language Models
  di: Kavehzadeh, Parsa, et al.
  Pubblicazione: (2024)
• Balcony: A Lightweight Approach to Dynamic Inference of Generative Language Models
  di: Jamialahmadi, Benyamin, et al.
  Pubblicazione: (2025)
• QDyLoRA: Quantized Dynamic Low-Rank Adaptation for Efficient Large Language Model Tuning
  di: Rajabzadeh, Hossein, et al.
  Pubblicazione: (2024)
• ECHO-LLaMA: Efficient Caching for High-Performance LLaMA Training
  di: Dialameh, Maryam, et al.
  Pubblicazione: (2025)