Direct Preference Knowledge Distillation for Large Language Models

Documenti analoghi

• MiniLLM: On-Policy Distillation of Large Language Models
  di: Gu, Yuxian, et al.
  Pubblicazione: (2023)
• Towards Optimal Learning of Language Models
  di: Gu, Yuxian, et al.
  Pubblicazione: (2024)
• Data Selection via Optimal Control for Language Models
  di: Gu, Yuxian, et al.
  Pubblicazione: (2024)
• Self-Boosting Large Language Models with Synthetic Preference Data
  di: Dong, Qingxiu, et al.
  Pubblicazione: (2024)
• Instruction Pre-Training: Language Models are Supervised Multitask Learners
  di: Cheng, Daixuan, et al.
  Pubblicazione: (2024)