Copertina

Overcoming Vocabulary Mismatch: Vocabulary-agnostic Teacher Guided Language Modeling

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Shin, Haebin, Ji, Lei, Liu, Xiao, Gong, Yeyun
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computation and Language Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

DynamixSFT: Dynamic Mixture Optimization of Instruction Tuning Collections
di: Shin, Haebin, et al.
Pubblicazione: (2025)

Generative Prompt Internalization
di: Shin, Haebin, et al.
Pubblicazione: (2024)

Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies
di: Tao, Chaofan, et al.
Pubblicazione: (2024)

Lossless Vocabulary Reduction for Auto-Regressive Language Models
di: Chijiwa, Daiki, et al.
Pubblicazione: (2025)

DVAGen: Dynamic Vocabulary Augmented Generation
di: Du, Wei, et al.
Pubblicazione: (2025)

BiasJailbreak:Analyzing Ethical Biases and Jailbreak Vulnerabilities in Large Language Models
di: Lee, Isack, et al.
Pubblicazione: (2024)

Fast Vocabulary Transfer for Language Model Compression
di: Gee, Leonidas, et al.
Pubblicazione: (2024)

Process-based Self-Rewarding Language Models
di: Zhang, Shimao, et al.
Pubblicazione: (2025)

CSV-Decode: Certifiable Sub-Vocabulary Decoding for Efficient Large Language Model Inference
di: Liu, Dong, et al.
Pubblicazione: (2025)

Efficient and Effective Vocabulary Expansion Towards Multilingual Large Language Models
di: Kim, Seungduk, et al.
Pubblicazione: (2024)

How Vocabulary Sharing Facilitates Multilingualism in LLaMA?
di: Yuan, Fei, et al.
Pubblicazione: (2023)

Enhancing Large Language Model Performance with Gradient-Based Parameter Selection
di: Li, Haoling, et al.
Pubblicazione: (2024)

An Empirical Study on Cross-lingual Vocabulary Adaptation for Efficient Language Model Inference
di: Yamaguchi, Atsuki, et al.
Pubblicazione: (2024)

Backward Lens: Projecting Language Model Gradients into the Vocabulary Space
di: Katz, Shahar, et al.
Pubblicazione: (2024)

Vocabulary Expansion of Large Language Models via Kullback-Leibler-Based Self-Distillation
di: Linder, Max Rehman
Pubblicazione: (2025)

The Tokenization Bottleneck: How Vocabulary Extension Improves Chemistry Representation Learning in Pretrained Language Models
di: Kalamkar, Prathamesh, et al.
Pubblicazione: (2025)

Scaling LLM Pre-training with Vocabulary Curriculum
di: Yu, Fangyuan
Pubblicazione: (2025)

VocabTailor: Dynamic Vocabulary Selection for Downstream Tasks in Small Language Models
di: Zhang, Hanling, et al.
Pubblicazione: (2025)

Open-Vocabulary Object Detection via Language Hierarchy
di: Huang, Jiaxing, et al.
Pubblicazione: (2024)

Vocabulary Dropout for Curriculum Diversity in LLM Co-Evolution
di: Dineen, Jacob, et al.
Pubblicazione: (2026)

How Does Alignment Enhance LLMs' Multilingual Capabilities? A Language Neurons Perspective
di: Zhang, Shimao, et al.
Pubblicazione: (2025)

Using Perspectival Words Is Harder Than Vocabulary Words for Humans and Even More So for Multimodal Language Models
di: Dong, Dota Tianai, et al.
Pubblicazione: (2025)

A Language-agnostic Model of Child Language Acquisition
di: Mahon, Louis, et al.
Pubblicazione: (2024)

FR-Spec: Accelerating Large-Vocabulary Language Models via Frequency-Ranked Speculative Sampling
di: Zhao, Weilin, et al.
Pubblicazione: (2025)

DynaSpec: Context-aware Dynamic Speculative Sampling for Large-Vocabulary Language Models
di: Zhang, Jinbin, et al.
Pubblicazione: (2025)

Dictionaries to the Rescue: Cross-Lingual Vocabulary Transfer for Low-Resource Languages Using Bilingual Dictionaries
di: Sakajo, Haruki, et al.
Pubblicazione: (2025)

We Can't Understand AI Using our Existing Vocabulary
di: Hewitt, John, et al.
Pubblicazione: (2025)

Happiness is Sharing a Vocabulary: A Study of Transliteration Methods
di: Jung, Haeji, et al.
Pubblicazione: (2025)

A Zero-Shot Open-Vocabulary Pipeline for Dialogue Understanding
di: Safa, Abdulfattah, et al.
Pubblicazione: (2024)

Column Vocabulary Association (CVA): semantic interpretation of dataless tables
di: Martorana, Margherita, et al.
Pubblicazione: (2024)

Now It Sounds Like You: Learning Personalized Vocabulary On Device
di: Wang, Sid, et al.
Pubblicazione: (2023)

Data Mixing Agent: Learning to Re-weight Domains for Continual Pre-training
di: Yang, Kailai, et al.
Pubblicazione: (2025)

Enhancing Chain-of-Thoughts Prompting with Iterative Bootstrapping in Large Language Models
di: Sun, Jiashuo, et al.
Pubblicazione: (2023)

CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquing
di: Gou, Zhibin, et al.
Pubblicazione: (2023)

Optimal Embedding Learning Rate in LLMs: The Effect of Vocabulary Size
di: Hayou, Soufiane, et al.
Pubblicazione: (2025)

How Can We Effectively Expand the Vocabulary of LLMs with 0.01GB of Target Language Text?
di: Yamaguchi, Atsuki, et al.
Pubblicazione: (2024)

Vocabulary embeddings organize linguistic structure early in language model training
di: Papadimitriou, Isabel, et al.
Pubblicazione: (2025)

Dynamic Vocabulary Pruning in Early-Exit LLMs
di: Vincenti, Jort, et al.
Pubblicazione: (2024)

Small Vocabularies, Big Gains: Pretraining and Tokenization in Time Series Models
di: Roger, Alexis, et al.
Pubblicazione: (2025)

World-to-Words: Grounded Open Vocabulary Acquisition through Fast Mapping in Vision-Language Models
di: Ma, Ziqiao, et al.
Pubblicazione: (2023)