Token Alignment via Character Matching for Subword Completion

Documenti analoghi

• BASS: Batched Attention-optimized Speculative Sampling
  di: Qian, Haifeng, et al.
  Pubblicazione: (2024)
• Bifurcated Attention: Accelerating Massively Parallel Decoding with Shared Prefixes in LLMs
  di: Athiwaratkun, Ben, et al.
  Pubblicazione: (2024)
• CodeFort: Robust Training for Code Generation Models
  di: Zhang, Yuhao, et al.
  Pubblicazione: (2024)
• Learning Mutually Informed Representations for Characters and Subwords
  di: Wang, Yilin, et al.
  Pubblicazione: (2023)
• The N-Grammys: Accelerating Autoregressive Inference with Learning-Free Batched Speculation
  di: Stewart, Lawrence, et al.
  Pubblicazione: (2024)