Self-Distillation Bridges Distribution Gap in Language Model Fine-Tuning

Documenti analoghi

• Multimodal DeepResearcher: Generating Text-Chart Interleaved Reports From Scratch with Agentic Framework
  di: Yang, Zhaorui, et al.
  Pubblicazione: (2025)
• Token Cleaning: Fine-Grained Data Selection for LLM Supervised Fine-Tuning
  di: Pang, Jinlong, et al.
  Pubblicazione: (2025)
• Phased Instruction Fine-Tuning for Large Language Models
  di: Pang, Wei, et al.
  Pubblicazione: (2024)
• Self-Distilled Reasoner: On-Policy Self-Distillation for Large Language Models
  di: Zhao, Siyan, et al.
  Pubblicazione: (2026)
• Efficiently Seeking Flat Minima for Better Generalization in Fine-Tuning Large Language Models and Beyond
  di: Deng, Jiaxin, et al.
  Pubblicazione: (2025)