LLM-NEO: Parameter Efficient Knowledge Distillation for Large Language Models

Documenti analoghi

• Shadow-FT: Tuning Instruct Model via Training on Paired Base Model
  di: Wu, Taiqiang, et al.
  Pubblicazione: (2025)
• Rethinking Kullback-Leibler Divergence in Knowledge Distillation for Large Language Models
  di: Wu, Taiqiang, et al.
  Pubblicazione: (2024)
• Revisiting Model Interpolation for Efficient Reasoning
  di: Wu, Taiqiang, et al.
  Pubblicazione: (2025)
• LoCa: Logit Calibration for Knowledge Distillation
  di: Yang, Runming, et al.
  Pubblicazione: (2024)
• Timber: Training-free Instruct Model Refining with Base via Effective Rank
  di: Wu, Taiqiang, et al.
  Pubblicazione: (2025)