An Efficient Inference Framework for Early-exit Large Language Models

Documenti analoghi

• Delta Knowledge Distillation for Large Language Models
  di: Cao, Yihan, et al.
  Pubblicazione: (2025)
• Scaling Inference-Efficient Language Models
  di: Bian, Song, et al.
  Pubblicazione: (2025)
• KDFlow: A User-Friendly and Efficient Knowledge Distillation Framework for Large Language Models
  di: Zhang, Songming, et al.
  Pubblicazione: (2026)
• Benchmarking Benchmark Leakage in Large Language Models
  di: Xu, Ruijie, et al.
  Pubblicazione: (2024)
• OpenELM: An Efficient Language Model Family with Open Training and Inference Framework
  di: Mehta, Sachin, et al.
  Pubblicazione: (2024)