Copertina

VerChol -- Grammar-First Tokenization for Agglutinative Languages

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autore principale:	Raja, Prabhu
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Tokenization Strategies for Low-Resource Agglutinative Languages in Word2Vec: Case Study on Turkish and Finnish
di: Hu, Jinfan Frank
Pubblicazione: (2025)

Marvelous Agglutinative Language Effect on Cross Lingual Transfer Learning
di: Kim, Wooyoung, et al.
Pubblicazione: (2022)

Bias Attribution in Filipino Language Models: Extending a Bias Interpretability Metric for Application on Agglutinative Languages
di: Gamboa, Lance Calvin Lim, et al.
Pubblicazione: (2025)

Inconsistent Tokenizations Cause Language Models to be Perplexed by Japanese Grammar
di: Gambardella, Andrew, et al.
Pubblicazione: (2025)

Adapting Large Language Models to a Low-Resource Agglutinative Language: A Comparative Study of LoRA and QLoRA for Bashkir
di: Arabov, Mullosharaf K., et al.
Pubblicazione: (2026)

Can LLMs Help Create Grammar?: Automating Grammar Creation for Endangered Languages with In-Context Learning
di: Spencer, Piyapath T, et al.
Pubblicazione: (2024)

Do Large Language Models Grasp The Grammar? Evidence from Grammar-Book-Guided Probing in Luxembourgish
di: Li, Lujun, et al.
Pubblicazione: (2025)

Triples-to-isiXhosa (T2X): Addressing the Challenges of Low-Resource Agglutinative Data-to-Text Generation
di: Meyer, Francois, et al.
Pubblicazione: (2024)

A First Context-Free Grammar Applied to Nawatl Corpora Augmentation
di: Guzmán-Landa, Juan-José, et al.
Pubblicazione: (2025)

PEDAL: Enhancing Greedy Decoding with Large Language Models using Diverse Exemplars
di: Prabhu, Sumanth
Pubblicazione: (2024)

Grammar Control in Dialogue Response Generation for Language Learning Chatbots
di: Glandorf, Dominik, et al.
Pubblicazione: (2025)

BoAT v2 -- A Web-Based Dependency Annotation Tool with Focus on Agglutinative Languages
di: Akkurt, Salih Furkan, et al.
Pubblicazione: (2022)

Leveraging Grammar Induction for Language Understanding and Generation
di: Kai, Jushi, et al.
Pubblicazione: (2024)

Grammaticality Judgments in Humans and Language Models: Revisiting Generative Grammar with LLMs
di: Johnsen, Lars G. B.
Pubblicazione: (2025)

Comparing Spoken Languages using Paninian System of Sounds and Finite State Machines
di: Prabhu, Shreekanth M, et al.
Pubblicazione: (2023)

Evaluating Small Decoder-Only Language Models for Grammar Correction and Text Simplification
di: Lamelas, Anthony
Pubblicazione: (2026)

Unraveling Syntax: How Language Models Learn Context-Free Grammars
di: Schulz, Laura Ying, et al.
Pubblicazione: (2025)

A Benchmark for Learning to Translate a New Language from One Grammar Book
di: Tanzer, Garrett, et al.
Pubblicazione: (2023)

Leveraging LLMs for Grammar Adaptation: A Study on Metamodel-Grammar Co-Evolution
di: Zhang, Weixing, et al.
Pubblicazione: (2026)

Problematic Tokens: Tokenizer Bias in Large Language Models
di: Yang, Jin, et al.
Pubblicazione: (2024)

Precise Robot Command Understanding Using Grammar-Constrained Large Language Models
di: Huo, Xinyun, et al.
Pubblicazione: (2026)

FUSE : A Ridge and Random Forest-Based Metric for Evaluating MT in Indigenous Languages
di: Raja, Rahul, et al.
Pubblicazione: (2025)

Dependency Transformer Grammars: Integrating Dependency Structures into Transformer Language Models
di: Zhao, Yida, et al.
Pubblicazione: (2024)

Disjoint Processing Mechanisms of Hierarchical and Linear Grammars in Large Language Models
di: Sankaranarayanan, Aruna, et al.
Pubblicazione: (2025)

Grammar-Forced Translation of Natural Language to Temporal Logic using LLMs
di: English, William, et al.
Pubblicazione: (2025)

Read it in Two Steps: Translating Extremely Low-Resource Languages with Code-Augmented Grammar Books
di: Zhang, Chen, et al.
Pubblicazione: (2025)

Zero-Shot Grammar Competency Estimation Using Large Language Model Generated Pseudo Labels
di: Das, Sourya Dipta, et al.
Pubblicazione: (2025)

Evaluation of NMT-Assisted Grammar Transfer for a Multi-Language Configurable Data-to-Text System
di: Madsack, Andreas, et al.
Pubblicazione: (2025)

CodeIP: A Grammar-Guided Multi-Bit Watermark for Large Language Models of Code
di: Guan, Batu, et al.
Pubblicazione: (2024)

"My Answer is C": First-Token Probabilities Do Not Match Text Answers in Instruction-Tuned Language Models
di: Wang, Xinpeng, et al.
Pubblicazione: (2024)

Grammar as a Behavioral Biometric: Using Cognitively Motivated Grammar Models for Authorship Verification
di: Nini, Andrea, et al.
Pubblicazione: (2024)

Rethinking Tokenization: Crafting Better Tokenizers for Large Language Models
di: Yang, Jinbiao
Pubblicazione: (2024)

Composing or Not Composing? Towards Distributional Construction Grammars
di: Blache, Philippe, et al.
Pubblicazione: (2024)

Grammar Assistance Using Syntactic Structures (GAUSS)
di: Zamaraeva, Olga, et al.
Pubblicazione: (2024)

Greedy Grammar Induction with Indirect Negative Evidence
di: Potashnik, Joseph
Pubblicazione: (2023)

Back to School: Translation Using Grammar Books
di: Hus, Jonathan, et al.
Pubblicazione: (2024)

ClaimVer: Explainable Claim-Level Verification and Evidence Attribution of Text Through Knowledge Graphs
di: Dammu, Preetam Prabhu Srikar, et al.
Pubblicazione: (2024)

Tokenization is Sensitive to Language Variation
di: Wegmann, Anna, et al.
Pubblicazione: (2025)

The First to Know: How Token Distributions Reveal Hidden Knowledge in Large Vision-Language Models?
di: Zhao, Qinyu, et al.
Pubblicazione: (2024)

Can LLMs Really Learn to Translate a Low-Resource Language from One Grammar Book?
di: Aycock, Seth, et al.
Pubblicazione: (2024)