MiniLLM: On-Policy Distillation of Large Language Models

Documenti analoghi

• Black-Box On-Policy Distillation of Large Language Models
  di: Ye, Tianzhu, et al.
  Pubblicazione: (2025)
• MiniPLM: Knowledge Distillation for Pre-Training Language Models
  di: Gu, Yuxian, et al.
  Pubblicazione: (2024)
• Towards Optimal Learning of Language Models
  di: Gu, Yuxian, et al.
  Pubblicazione: (2024)
• Direct Preference Knowledge Distillation for Large Language Models
  di: Li, Yixing, et al.
  Pubblicazione: (2024)
• Data Selection via Optimal Control for Language Models
  di: Gu, Yuxian, et al.
  Pubblicazione: (2024)