Inconsistent Tokenizations Cause Language Models to be Perplexed by Japanese Grammar

Documenti analoghi

• Semantic Token Clustering for Efficient Uncertainty Quantification in Large Language Models
  di: Cao, Qi, et al.
  Pubblicazione: (2026)
• Language Models Do Hard Arithmetic Tasks Easily and Hardly Do Easy Arithmetic Tasks
  di: Gambardella, Andrew, et al.
  Pubblicazione: (2024)
• Which Programming Language and What Features at Pre-training Stage Affect Downstream Logical Inference Performance?
  di: Uchiyama, Fumiya, et al.
  Pubblicazione: (2024)
• Safe Transformer: An Explicit Safety Bit For Interpretable And Controllable Alignment
  di: Feng, Jingyuan, et al.
  Pubblicazione: (2026)
• Rethinking Evaluation of Sparse Autoencoders through the Representation of Polysemous Words
  di: Minegishi, Gouki, et al.
  Pubblicazione: (2025)