Image de couverture de livre

On the Effect of (Near) Duplicate Subwords in Language Modelling

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Schäfer, Anton, Hofmann, Thomas, Schlag, Imanol, Pimentel, Tiago
Format:	Preprint
Publié:	2024
Sujets:	Computation and Language Machine Learning I.2.7
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

The Role of Language Imbalance in Cross-lingual Generalisation: Insights from Cloned Language Experiments
par: Schäfer, Anton, et autres
Publié: (2024)

Subword-Based Comparative Linguistics across 242 Languages Using Wikipedia Glottosets
par: Chelombitko, Iaroslav, et autres
Publié: (2026)

Engineering A Large Language Model From Scratch
par: Oketunji, Abiodun Finbarrs
Publié: (2024)

Large Language Model (LLM) Bias Index -- LLMBI
par: Oketunji, Abiodun Finbarrs, et autres
Publié: (2023)

Memory Bank Compression for Continual Adaptation of Large Language Models
par: Katraouras, Thomas, et autres
Publié: (2026)

Evaluating the Efficacy of Hybrid Deep Learning Models in Distinguishing AI-Generated Text
par: Oketunji, Abiodun Finbarrs
Publié: (2023)

Ensemble Language Models for Multilingual Sentiment Analysis
par: Hasan, Md Arid
Publié: (2024)

RBCorr: Response Bias Correction in Language Models
par: Bhatt, Om, et autres
Publié: (2026)

Compact Example-Based Explanations for Language Models
par: Schoenegger, Loris, et autres
Publié: (2026)

The Open Source Advantage in Large Language Models (LLMs)
par: Manchanda, Jiya, et autres
Publié: (2024)

Scaling Laws for Forgetting When Fine-Tuning Large Language Models
par: Kalajdzievski, Damjan
Publié: (2024)

Sparsing Law: Towards Large Language Models with Greater Activation Sparsity
par: Luo, Yuqi, et autres
Publié: (2024)

MMSciBench: Benchmarking Language Models on Chinese Multimodal Scientific Problems
par: Ye, Xinwu, et autres
Publié: (2025)

Distilling Robustness into Natural Language Inference Models with Domain-Targeted Augmentation
par: Stacey, Joe, et autres
Publié: (2023)

MedFuzz: Exploring the Robustness of Large Language Models in Medical Question Answering
par: Ness, Robert Osazuwa, et autres
Publié: (2024)

From Facts to Folklore: Evaluating Large Language Models on Bengali Cultural Knowledge
par: Chowdhury, Nafis, et autres
Publié: (2025)

Language Models Are Implicitly Continuous
par: Marro, Samuele, et autres
Publié: (2025)

Where Should LoRA Go? Component-Type Placement in Hybrid Language Models
par: Borobia, Hector, et autres
Publié: (2026)

Entropy-Based Measurement of Value Drift and Alignment Work in Large Language Models
par: Fadli, Samih
Publié: (2025)

Context-Aware Clustering using Large Language Models
par: Tipirneni, Sindhu, et autres
Publié: (2024)

Combining Language and Topic Models for Hierarchical Text Classification
par: Toit, Jaco du, et autres
Publié: (2025)

Constraint-Driven Small Language Models Based on Agent and OpenAlex Knowledge Graph: Mining Conceptual Pathways and Discovering Innovation Points in Academic Papers
par: Xia, Ziye, et autres
Publié: (2025)

RightNow-Arabic-0.5B-Turbo: An Open Sub-1B Arabic Language Model via Vocabulary Injection and Edge-First Deployment
par: Jaber, Jaber, et autres
Publié: (2026)

Rethinking Addressing in Language Models via Contexualized Equivariant Positional Encoding
par: Zhu, Jiajun, et autres
Publié: (2025)

Kronecker Embeddings: Byte-Level Structured Token Representations for Parameter-Efficient Language Models
par: Shravan, Rohan
Publié: (2026)

How Language Models Process Out-of-Distribution Inputs: A Two-Pathway Framework
par: Saghir, Hamidreza
Publié: (2026)

Efficacy of ByT5 in Multilingual Translation of Biblical Texts for Underrepresented Languages
par: Aars, Corinne, et autres
Publié: (2024)

Linguistically-Informed Multilingual Instruction Tuning: Is There an Optimal Set of Languages to Tune?
par: Soykan, Gürkan, et autres
Publié: (2024)

HYPEROFA: Expanding LLM Vocabulary to New Languages via Hypernetwork-Based Embedding Initialization
par: Özeren, Enes, et autres
Publié: (2025)

Improving the Capabilities of Large Language Model Based Marketing Analytics Copilots With Semantic Search And Fine-Tuning
par: Gao, Yilin, et autres
Publié: (2024)

Neural Activation Patterns Across Language Model Architectures: A Comprehensive Analysis of Cognitive Task Performance
par: Naser-Moghadasi, Mahdi, et autres
Publié: (2026)

SampoNLP: A Self-Referential Toolkit for Morphological Analysis of Subword Tokenizers
par: Chelombitko, Iaroslav, et autres
Publié: (2026)

KenSwQuAD -- A Question Answering Dataset for Swahili Low Resource Language
par: Wanjawa, Barack W., et autres
Publié: (2022)

Future Token Prediction -- Causal Language Modelling with Per-Token Semantic State Vector for Multi-Token Prediction
par: Walker, Nicholas
Publié: (2024)

Identifying and Mitigating the Influence of the Prior Distribution in Large Language Models
par: Zhang, Liyi, et autres
Publié: (2025)

Your Pretrained Model Tells the Difficulty Itself: A Self-Adaptive Curriculum Learning Paradigm for Natural Language Understanding
par: Feng, Qi, et autres
Publié: (2025)

Better and Worse with Scale: How Contextual Entrainment Diverges with Model Size
par: Kukreja, Dikshant, et autres
Publié: (2026)

Hardware Co-Design Scaling Laws via Roofline Modelling for On-Device LLMs
par: Sun, Luoyang, et autres
Publié: (2026)

Have Faith in Faithfulness: Going Beyond Circuit Overlap When Finding Model Mechanisms
par: Hanna, Michael, et autres
Publié: (2024)

BabyLlama-2: Ensemble-Distilled Models Consistently Outperform Teachers With Limited Data
par: Tastet, Jean-Loup, et autres
Publié: (2024)