Sentence-Level or Token-Level? A Comprehensive Study on Knowledge Distillation

Documenti analoghi

• A Survey on Image-text Multimodal Models
  di: Guo, Ruifeng, et al.
  Pubblicazione: (2023)
• Efficient-Empathy: Towards Efficient and Effective Selection of Empathy Data
  di: Sun, Linzhuang, et al.
  Pubblicazione: (2024)
• BEATS: Optimizing LLM Mathematical Capabilities with BackVerify and Adaptive Disambiguate based Efficient Tree Search
  di: Sun, Linzhuang, et al.
  Pubblicazione: (2024)
• Retrieval Meets Reasoning: Even High-school Textbook Knowledge Benefits Multimodal Reasoning
  di: Tan, Cheng, et al.
  Pubblicazione: (2024)
• Distilling Token-Trained Models into Byte-Level Models
  di: Bao, Zishuo, et al.
  Pubblicazione: (2026)