Demystifying Low-Rank Knowledge Distillation in Large Language Models: Convergence, Generalization, and Information-Theoretic Guarantees

Documenti analoghi

• Enhancing Self-Correction in Large Language Models through Multi-Perspective Reflection
  di: Costa, Mariana, et al.
  Pubblicazione: (2026)
• Demystifying Verbatim Memorization in Large Language Models
  di: Huang, Jing, et al.
  Pubblicazione: (2024)
• Demystifying Language Model Forgetting with Low-rank Example Associations
  di: Jin, Xisen, et al.
  Pubblicazione: (2024)
• A Survey on Symbolic Knowledge Distillation of Large Language Models
  di: Acharya, Kamal, et al.
  Pubblicazione: (2024)
• Scaling Reasoning Hop Exposes Weaknesses: Demystifying and Improving Hop Generalization in Large Language Models
  di: Li, Zhaoyi, et al.
  Pubblicazione: (2026)