Put Teacher in Student's Shoes: Cross-Distillation for Ultra-compact Model Compression Framework

Documenti analoghi

• Let's Put Ourselves in Sally's Shoes: Shoes-of-Others Prefilling Improves Theory of Mind in Large Language Models
  di: Shinoda, Kazutoshi, et al.
  Pubblicazione: (2025)
• Putting People in LLMs' Shoes: Generating Better Answers via Question Rewriter
  di: Chen, Junhao, et al.
  Pubblicazione: (2024)
• Prompt Candidates, then Distill: A Teacher-Student Framework for LLM-driven Data Annotation
  di: Xia, Mingxuan, et al.
  Pubblicazione: (2025)
• XQuant: Achieving Ultra-Low Bit KV Cache Quantization with Cross-Layer Compression
  di: Yang, Haoqi, et al.
  Pubblicazione: (2025)
• AdaSwitch: Balancing Exploration and Guidance in Knowledge Distillation via Adaptive Switching
  di: Peng, Jingyu, et al.
  Pubblicazione: (2025)