Universal Cross-Tokenizer Distillation via Approximate Likelihood Matching

Documenti analoghi

• Zero-Shot Tokenizer Transfer
  di: Minixhofer, Benjamin, et al.
  Pubblicazione: (2024)
• Retrofitting Large Language Models with Dynamic Tokenization
  di: Feher, Darius, et al.
  Pubblicazione: (2024)
• Segment Any Text: A Universal Approach for Robust, Efficient and Adaptable Sentence Segmentation
  di: Frohmann, Markus, et al.
  Pubblicazione: (2024)
• Emergent Communication Pretraining for Few-Shot Machine Translation
  di: Li, Yaoyiran, et al.
  Pubblicazione: (2020)
• Cross-Lingual and Cross-Cultural Variation in Image Descriptions
  di: Berger, Uri, et al.
  Pubblicazione: (2024)