Chain-based Distillation for Effective Initialization of Variable-Sized Small Language Models

Documenti analoghi

• XPERT: Expert Knowledge Transfer for Effective Training of Language Models
  di: Liu, Chang, et al.
  Pubblicazione: (2026)
• Learngene Search Across Multiple Datasets for Building Variable-Sized Models
  di: Shi, Boyu, et al.
  Pubblicazione: (2026)
• Understanding Performance Collapse in Layer-Pruned Large Language Models via Decision Representation Transitions
  di: Shi, Boyu, et al.
  Pubblicazione: (2026)
• Thinking-Free Policy Initialization Makes Distilled Reasoning Models More Effective and Efficient Reasoners
  di: Xu, Xin, et al.
  Pubblicazione: (2025)
• Effectiveness of Chain-of-Thought in Distilling Reasoning Capability from Large Language Models
  di: Do, Cong-Thanh, et al.
  Pubblicazione: (2025)