Shadow-FT: Tuning Instruct Model via Training on Paired Base Model

Documenti analoghi

• LLM-NEO: Parameter Efficient Knowledge Distillation for Large Language Models
  di: Yang, Runming, et al.
  Pubblicazione: (2024)
• Timber: Training-free Instruct Model Refining with Base via Effective Rank
  di: Wu, Taiqiang, et al.
  Pubblicazione: (2025)
• Revisiting Model Interpolation for Efficient Reasoning
  di: Wu, Taiqiang, et al.
  Pubblicazione: (2025)
• Rethinking Kullback-Leibler Divergence in Knowledge Distillation for Large Language Models
  di: Wu, Taiqiang, et al.
  Pubblicazione: (2024)
• ProFit: Leveraging High-Value Signals in SFT via Probability-Guided Token Selection
  di: Liu, Tao, et al.
  Pubblicazione: (2026)