Image de couverture de livre

Parallel Tokenizers: Rethinking Vocabulary Design for Cross-Lingual Transfer

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Kautsar, Muhammad Dehan Al, Koto, Fajri
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

What Do Indonesians Really Need from Language Technology? A Nationwide Survey
par: Kautsar, Muhammad Dehan Al, et autres
Publié: (2025)

Grounding AI-in-Education Development in Teachers' Voices: Findings from a National Survey in Indonesia
par: Aisyah, Nurul, et autres
Publié: (2026)

IndoSafety: Culturally Grounded Safety for LLMs in Indonesian Languages
par: Azmi, Muhammad Falensi, et autres
Publié: (2025)

Simulating Training Data Leakage in Multiple-Choice Benchmarks for LLM Evaluation
par: Hidayat, Naila Shafirni, et autres
Publié: (2025)

Evaluating Vision-Language and Large Language Models for Automated Student Assessment in Indonesian Classrooms
par: Aisyah, Nurul, et autres
Publié: (2025)

Role-Aware Language Models for Secure and Contextualized Access Control in Organizations
par: Almheiri, Saeed, et autres
Publié: (2025)

Vision Language Models are Confused Tourists
par: Irawan, Patrick Amadeus, et autres
Publié: (2025)

Cracking the Code: Multi-domain LLM Evaluation on Real-World Professional Exams in Indonesia
par: Koto, Fajri
Publié: (2024)

SEADialogues: A Multilingual Culturally Grounded Multi-turn Dialogue Dataset on Southeast Asian Languages
par: Kautsar, Muhammad Dehan Al, et autres
Publié: (2025)

Preserving Fairness and Safety in Quantized LLMs Through Critical Weight Protection
par: Hakim, Muhammad Alif Al, et autres
Publié: (2026)

Unveiling Cultural Blind Spots: Analyzing the Limitations of mLLMs in Procedural Text Comprehension
par: Yari, Amir Hossein, et autres
Publié: (2025)

Cross-Cultural Transfer of Commonsense Reasoning in LLMs: Evidence from the Arab World
par: Almheiri, Saeed, et autres
Publié: (2025)

Low-Resource Safety Failures Are Action Failures, Not Representation Failures
par: Aziz, Rashad, et autres
Publié: (2026)

IndoCulture: Exploring Geographically-Influenced Cultural Commonsense Reasoning Across Eleven Indonesian Provinces
par: Koto, Fajri, et autres
Publié: (2024)

Investigating the Effect of Parallel Data in the Cross-Lingual Transfer for Vision-Language Encoders
par: Manea, Andrei-Alexandru, et autres
Publié: (2025)

Are Multilingual LLMs Culturally-Diverse Reasoners? An Investigation into Multicultural Proverbs and Sayings
par: Liu, Chen Cecilia, et autres
Publié: (2023)

Exploring Language-Agnosticity in Function Vectors: A Case Study in Machine Translation
par: Laiyk, Nurkhan, et autres
Publié: (2026)

Listen, Correct, and Feed Back: Spoken Pedagogical Feedback Generation
par: Liang, Junhong, et autres
Publié: (2026)

ANHALTEN: Cross-Lingual Transfer for German Token-Level Reference-Free Hallucination Detection
par: Herrlein, Janek, et autres
Publié: (2024)

Dictionaries to the Rescue: Cross-Lingual Vocabulary Transfer for Low-Resource Languages Using Bilingual Dictionaries
par: Sakajo, Haruki, et autres
Publié: (2025)

The Devil Is in the Word Alignment Details: On Translation-Based Cross-Lingual Transfer for Token Classification Tasks
par: Ebing, Benedikt, et autres
Publié: (2025)

Revisiting Metric Reliability for Fine-grained Evaluation of Machine Translation and Summarization in Indian Languages
par: Yari, Amir Hossein, et autres
Publié: (2025)

LLMs as Cultural Archives: Cultural Commonsense Knowledge Graph Extraction
par: Tonga, Junior Cedric, et autres
Publié: (2026)

Zero-shot Sentiment Analysis in Low-Resource Languages Using a Multilingual Sentiment Lexicon
par: Koto, Fajri, et autres
Publié: (2024)

Why Better Cross-Lingual Alignment Fails for Better Cross-Lingual Transfer: Case of Encoders
par: Veitsman, Yana, et autres
Publié: (2026)

A Parallel Cross-Lingual Benchmark for Multimodal Idiomaticity Understanding
par: Torunoğlu-Selamet, Dilara, et autres
Publié: (2026)

Culturally-Nuanced Story Generation for Reasoning in Low-Resource Languages: The Case of Javanese and Sundanese
par: Pranida, Salsabila Zahirah, et autres
Publié: (2025)

Cross-Lingual Transfer Learning for Speech Translation
par: Ma, Rao, et autres
Publié: (2024)

Cultural Benchmarking of LLMs in Standard and Dialectal Arabic Dialogues
par: Kautsar, Muhammad Dehan Al, et autres
Publié: (2026)

Cross-Lingual Transfer of Cultural Knowledge: An Asymmetric Phenomenon
par: Zhang, Chen, et autres
Publié: (2025)

The Impact of Language Adapters in Cross-Lingual Transfer for NLU
par: Kunz, Jenny, et autres
Publié: (2024)

Generalization Measures for Zero-Shot Cross-Lingual Transfer
par: Bassi, Saksham, et autres
Publié: (2024)

Unknown Script: Impact of Script on Cross-Lingual Transfer
par: Tufa, Wondimagegnhue Tsegaye, et autres
Publié: (2024)

IndoBias: A Dual Track Culturally Grounded Benchmark for LLMs Bias Evaluation in Indonesian Languages
par: Hanif, Ikhlasul Akmal, et autres
Publié: (2026)

Tokenization and Morphological Fidelity in Uralic NLP: A Cross-Lingual Evaluation
par: Xu, Nuo, et autres
Publié: (2026)

Trans-Tokenization and Cross-lingual Vocabulary Transfers: Language Adaptation of LLMs for Low-Resource NLP
par: Remy, François, et autres
Publié: (2024)

Cross-Lingual Transfer for Low-Resource Natural Language Processing
par: García-Ferrero, Iker
Publié: (2025)

Cross-Lingual Optimization for Language Transfer in Large Language Models
par: Lee, Jungseob, et autres
Publié: (2025)

Marvelous Agglutinative Language Effect on Cross Lingual Transfer Learning
par: Kim, Wooyoung, et autres
Publié: (2022)

Incorporating Lexical and Syntactic Knowledge for Unsupervised Cross-Lingual Transfer
par: Zheng, Jianyu, et autres
Publié: (2024)