Beyond Fertility: Analyzing STRR as a Metric for Multilingual Tokenization Evaluation

Documenti analoghi

• Stop Taking Tokenizers for Granted: They Are Core Design Decisions in Large Language Models
  di: Alqahtani, Sawsan, et al.
  Pubblicazione: (2026)
• BenLLMEval: A Comprehensive Evaluation into the Potentials and Pitfalls of Large Language Models on Bengali NLP
  di: Kabir, Mohsinul, et al.
  Pubblicazione: (2023)
• A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and Recommendations
  di: Laskar, Md Tahmid Rahman, et al.
  Pubblicazione: (2024)
• Which English Do LLMs Prefer? Triangulating Structural Bias Towards American English in Foundation Models
  di: Nayeem, Mir Tafseer, et al.
  Pubblicazione: (2026)
• Beyond LLM-as-a-Judge: Deterministic Metrics for Multilingual Generative Text Evaluation
  di: Alam, Firoj, et al.
  Pubblicazione: (2026)