Lillama: Large Language Models Compression via Low-Rank Feature Distillation

Documenti analoghi

• BaldWhisper: Faster Whisper with Head Shearing and Layer Merging
  di: Sy, Yaya, et al.
  Pubblicazione: (2025)
• Speech Language Models for Under-Represented Languages: Insights from Wolof
  di: Sy, Yaya, et al.
  Pubblicazione: (2025)
• Cross-lingual Matryoshka Representation Learning across Speech and Text
  di: Sy, Yaya, et al.
  Pubblicazione: (2026)
• Low-Rank Compression of Language Models via Differentiable Rank Selection
  di: Sundrani, Sidhant, et al.
  Pubblicazione: (2025)
• Compressing Large Language Models using Low Rank and Low Precision Decomposition
  di: Saha, Rajarshi, et al.
  Pubblicazione: (2024)