Imagen de Portada

Team Ryu's Submission to SIGMORPHON 2024 Shared Task on Subword Tokenization

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autor principal:	Li, Zilong
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Evaluating Subword Tokenization: Alien Subword Composition and OOV Generalization Challenge
por: Batsuren, Khuyagbaatar, et al.
Publicado: (2024)

HW-TSC's Submission to the CCMT 2024 Machine Translation Tasks
por: Wu, Zhanglin, et al.
Publicado: (2024)

Token Alignment via Character Matching for Subword Completion
por: Athiwaratkun, Ben, et al.
Publicado: (2024)

Yes-MT's Submission to the Low-Resource Indic Language Translation Shared Task in WMT 2024
por: Bhaskar, Yash, et al.
Publicado: (2025)

T-FREE: Subword Tokenizer-Free Generative LLMs via Sparse Representations for Memory-Efficient Embeddings
por: Deiseroth, Björn, et al.
Publicado: (2024)

NADI 2024: The Fifth Nuanced Arabic Dialect Identification Shared Task
por: Abdul-Mageed, Muhammad, et al.
Publicado: (2024)

WojoodNER 2024: The Second Arabic Named Entity Recognition Shared Task
por: Jarrar, Mustafa, et al.
Publicado: (2024)

Hybrid OCR-LLM Framework for Enterprise-Scale Document Information Extraction Under Copy-heavy Task
por: Wang, Zilong, et al.
Publicado: (2025)

Understanding Subword Compositionality of Large Language Models
por: Peng, Qiwei, et al.
Publicado: (2025)

LGSE: Lexically Grounded Subword Embedding Initialization for Low-Resource Language Adaptation
por: Teklehaymanot, Hailay, et al.
Publicado: (2026)

Team QUST at SemEval-2024 Task 8: A Comprehensive Study of Monolingual and Multilingual Approaches for Detecting AI-generated Text
por: Xu, Xiaoman, et al.
Publicado: (2024)

Overview of the EHRSQL 2024 Shared Task on Reliable Text-to-SQL Modeling on Electronic Health Records
por: Lee, Gyubok, et al.
Publicado: (2024)

Optimal Turkish Subword Strategies at Scale: Systematic Evaluation of Data, Vocabulary, Morphology Interplay
por: Altinok, Duygu
Publicado: (2026)

TeamLLM: A Human-Like Team-Oriented Collaboration Framework for Multi-Step Contextualized Tasks
por: Wang, Xiangyu, et al.
Publicado: (2026)

Combining Supervised Learning and Reinforcement Learning for Multi-Label Classification Tasks with Partial Labels
por: Jia, Zixia, et al.
Publicado: (2024)

TokDrift: When LLM Speaks in Subwords but Code Speaks in Grammar
por: Li, Yinxi, et al.
Publicado: (2025)

SemShareKV: Efficient KVCache Sharing for Semantically Similar Prompts via Token-Level LSH Matching
por: Zhao, Xinye, et al.
Publicado: (2025)

KIT's Offline Speech Translation and Instruction Following Submission for IWSLT 2025
por: Koneru, Sai, et al.
Publicado: (2025)

Rubrics to Tokens: Bridging Response-level Rubrics and Token-level Rewards in Instruction Following Tasks
por: Xu, Tianze, et al.
Publicado: (2026)

Tokenization and Representation Biases in Multilingual Models on Dialectal NLP Tasks
por: Kanjirangat, Vani, et al.
Publicado: (2025)

AHaSIS: Shared Task on Sentiment Analysis for Arabic Dialects
por: Alharbi, Maram, et al.
Publicado: (2025)

Do Not Let Low-Probability Tokens Over-Dominate in RL for LLMs
por: Yang, Zhihe, et al.
Publicado: (2025)

HySparse: A Hybrid Sparse Attention Architecture with Oracle Token Selection and KV Cache Sharing
por: Gao, Yizhao, et al.
Publicado: (2026)

Improving the Efficiency of Language Agent Teams with Adaptive Task Graphs
por: Mieczkowski, Elizabeth, et al.
Publicado: (2026)

From Pixels to Tokens: Byte-Pair Encoding on Quantized Visual Modalities
por: Zhang, Wanpeng, et al.
Publicado: (2024)

MetricX-24: The Google Submission to the WMT 2024 Metrics Shared Task
por: Juraska, Juraj, et al.
Publicado: (2024)

SPRING Lab IITM's submission to Low Resource Indic Language Translation Shared Task
por: Sayed, Hamees, et al.
Publicado: (2024)

M-DAIGT: A Shared Task on Multi-Domain Detection of AI-Generated Text
por: Lamsiyah, Salima, et al.
Publicado: (2025)

Shared Lexical Task Representations Explain Behavioral Variability In LLMs
por: Yang, Zhuonan, et al.
Publicado: (2026)

Next-Token Prediction Task Assumes Optimal Data Ordering for LLM Training in Proof Generation
por: An, Chenyang, et al.
Publicado: (2024)

Same Task, More Tokens: the Impact of Input Length on the Reasoning Performance of Large Language Models
por: Levy, Mosh, et al.
Publicado: (2024)

OUNLP at TSAR 2025 Shared Task: Multi-Round Text Simplifier via Code Generation
por: Huynh, Cuong, et al.
Publicado: (2025)

mucAI at BAREC Shared Task 2025: Towards Uncertainty Aware Arabic Readability Assessment
por: Abdou, Ahmed
Publicado: (2025)

Findings of the BlackboxNLP 2025 Shared Task: Localizing Circuits and Causal Variables in Language Models
por: Arad, Dana, et al.
Publicado: (2025)

1 Trillion Token (1TT) Platform: A Novel Framework for Efficient Data Sharing and Compensation in Large Language Models
por: Park, Chanjun, et al.
Publicado: (2024)

KNOWCOMP POKEMON Team at DialAM-2024: A Two-Stage Pipeline for Detecting Relations in Dialogical Argument Mining
por: Zheng, Zihao, et al.
Publicado: (2024)

Can ChatGPT replace StackOverflow? A Study on Robustness and Reliability of Large Language Model Code Generation
por: Zhong, Li, et al.
Publicado: (2023)

NLIP_Lab-IITH Low-Resource MT System for WMT24 Indic MT Shared Task
por: Sahoo, Pramit, et al.
Publicado: (2024)

BlackboxNLP-2025 MIB Shared Task: Improving Circuit Faithfulness via Better Edge Selection
por: Nikankin, Yaniv, et al.
Publicado: (2025)

RETUYT-INCO at BEA 2026 Shared Task 2: Meta-prompting in Rubric-based Scoring for German
por: Sastre, Ignacio, et al.
Publicado: (2026)