Imagen de Portada

Tokenization Strategies for Low-Resource Agglutinative Languages in Word2Vec: Case Study on Turkish and Finnish

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autor principal:	Hu, Jinfan Frank
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

VerChol -- Grammar-First Tokenization for Agglutinative Languages
por: Raja, Prabhu
Publicado: (2026)

Benchmarking Procedural Language Understanding for Low-Resource Languages: A Case Study on Turkish
por: Uzunoglu, Arda, et al.
Publicado: (2023)

Adapting Large Language Models to a Low-Resource Agglutinative Language: A Comparative Study of LoRA and QLoRA for Bashkir
por: Arabov, Mullosharaf K., et al.
Publicado: (2026)

Evaluating the Quality of Benchmark Datasets for Low-Resource Languages: A Case Study on Turkish
por: Cengiz, Ayşe Aysu, et al.
Publicado: (2025)

Triples-to-isiXhosa (T2X): Addressing the Challenges of Low-Resource Agglutinative Data-to-Text Generation
por: Meyer, Francois, et al.
Publicado: (2024)

Language Models Implement Simple Word2Vec-style Vector Arithmetic
por: Merullo, Jack, et al.
Publicado: (2023)

Modelling the Morphology of Verbal Paradigms: A Case Study in the Tokenization of Turkish and Hebrew
por: Samo, Giuseppe, et al.
Publicado: (2026)

Cross-Lingual Learning vs. Low-Resource Fine-Tuning: A Case Study with Fact-Checking in Turkish
por: Cekinel, Recep Firat, et al.
Publicado: (2024)

Reducing Tokenization Premiums for Low-Resource Languages
por: Churchill, Geoffrey, et al.
Publicado: (2026)

Spoken Word2Vec: Learning Skipgram Embeddings from Speech
por: Sayeed, Mohammad Amaan, et al.
Publicado: (2023)

Subword Tokenization Strategies for Kurdish Word Embeddings
por: Salehi, Ali, et al.
Publicado: (2025)

Marvelous Agglutinative Language Effect on Cross Lingual Transfer Learning
por: Kim, Wooyoung, et al.
Publicado: (2022)

Bridging the Bosphorus: Advancing Turkish Large Language Models through Strategies for Low-Resource Language Adaptation and Benchmarking
por: Acikgoz, Emre Can, et al.
Publicado: (2024)

Whisper Turns Stronger: Augmenting Wav2Vec 2.0 for Superior ASR in Low-Resource Languages
por: Anidjar, Or Haim, et al.
Publicado: (2024)

Adaptability of ASR Models on Low-Resource Language: A Comparative Study of Whisper and Wav2Vec-BERT on Bangla
por: Ridoy, Md Sazzadul Islam, et al.
Publicado: (2025)

Introducing Syllable Tokenization for Low-resource Languages: A Case Study with Swahili
por: Atuhurra, Jesse, et al.
Publicado: (2024)

Comparative Analysis of Tokenization Algorithms for Low-Resource Language Dzongkha
por: Wangchuk, Tandin, et al.
Publicado: (2025)

Turkronicles: Diachronic Resources for the Fast Evolving Turkish Language
por: Yazar, Togay, et al.
Publicado: (2024)

From Rosetta to Match-Up: A Paired Corpus of Linguistic Puzzles with Human and LLM Benchmarks
por: Majmudar, Neh, et al.
Publicado: (2026)

Word Recovery in Large Language Models Enables Character-Level Tokenization Robustness
por: Yang, Zhipeng, et al.
Publicado: (2026)

Constructing Vec-tionaries to Extract Message Features from Texts: A Case Study of Moral Appeals
por: Duan, Zening, et al.
Publicado: (2023)

From Word2Vec to Transformers: Text-Derived Composition Embeddings for Filtering Combinatorial Electrocatalysts
por: Zhang, Lei, et al.
Publicado: (2026)

Bias Attribution in Filipino Language Models: Extending a Bias Interpretability Metric for Application on Agglutinative Languages
por: Gamboa, Lance Calvin Lim, et al.
Publicado: (2025)

Building Foundations for Natural Language Processing of Historical Turkish: Resources and Models
por: Özateş, Şaziye Betül, et al.
Publicado: (2025)

Sinhala-English Word Embedding Alignment: Introducing Datasets and Benchmark for a Low Resource Language
por: Wickramasinghe, Kasun, et al.
Publicado: (2023)

Understanding In-Context Machine Translation for Low-Resource Languages: A Case Study on Manchu
por: Pei, Renhao, et al.
Publicado: (2025)

Low-Resource NMT: A Case Study on the Written and Spoken Languages in Hong Kong
por: Mak, Hei Yi, et al.
Publicado: (2025)

A Comprehensive Analysis of Static Word Embeddings for Turkish
por: Sarıtaş, Karahan, et al.
Publicado: (2024)

Prompt Engineering Using GPT for Word-Level Code-Mixed Language Identification in Low-Resource Dravidian Languages
por: Deroy, Aniket, et al.
Publicado: (2024)

Closed-Form Training Dynamics Reveal Learned Features and Linear Structure in Word2Vec-like Models
por: Karkada, Dhruva, et al.
Publicado: (2025)

Multimodal Large Language Models for Low-Resource Languages: A Case Study for Basque
por: Arana, Lukas, et al.
Publicado: (2025)

LLM2Vec-Gen: Generative Embeddings from Large Language Models
por: BehnamGhader, Parishad, et al.
Publicado: (2026)

Llama2Vec: Unsupervised Adaptation of Large Language Models for Dense Retrieval
por: Liu, Zheng, et al.
Publicado: (2023)

HeceTokenizer: A Syllable-Based Tokenization Approach for Turkish Retrieval
por: Gulgonul, Senol
Publicado: (2026)

Causal2Vec: Improving Decoder-only LLMs as Embedding Models through a Contextual Token
por: Lin, Ailiang, et al.
Publicado: (2025)

Entropy2Vec: Crosslingual Language Modeling Entropy as End-to-End Learnable Language Representations
por: Irawan, Patrick Amadeus, et al.
Publicado: (2025)

Diacritic Restoration for Low-Resource Indigenous Languages: Case Study with Bribri and Cook Islands Māori
por: Coto-Solano, Rolando, et al.
Publicado: (2025)

Investigating Neural Machine Translation for Low-Resource Languages: Using Bavarian as a Case Study
por: Her, Wan-Hua, et al.
Publicado: (2024)

Gram2Vec: An Interpretable Document Vectorizer
por: Zeng, Peter, et al.
Publicado: (2024)

VecGlypher: Unified Vector Glyph Generation with Language Models
por: Huang, Xiaoke, et al.
Publicado: (2026)