On the Generalization vs Fidelity Paradox in Knowledge Distillation

Documenti analoghi

• Step-by-Step Unmasking for Parameter-Efficient Fine-tuning of Large Language Models
  di: Agarwal, Aradhye, et al.
  Pubblicazione: (2024)
• From Images to Words: Efficient Cross-Modal Knowledge Distillation to Language Models from Black-box Teachers
  di: Sengupta, Ayan, et al.
  Pubblicazione: (2026)
• The Art of Scaling Test-Time Compute for Large Language Models
  di: Agarwal, Aradhye, et al.
  Pubblicazione: (2025)
• First Finish Search: Efficient Test-Time Scaling in Large Language Models
  di: Agarwal, Aradhye, et al.
  Pubblicazione: (2025)
• Compression Laws for Large Language Models
  di: Sengupta, Ayan, et al.
  Pubblicazione: (2025)