Copertina

How Tokenization Limits Phonological Knowledge Representation in Language Models and How to Improve Them

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Liao, Disen, Shi, Freda
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Distribution Prompting: Understanding the Expressivity of Language Models Through the Next-Token Distributions They Can Produce
di: Wang, Haojin, et al.
Pubblicazione: (2025)

Learning Language Structures through Grounding
di: Shi, Freda
Pubblicazione: (2024)

LingGym: How Far Are LLMs from Thinking Like Field Linguists?
di: Yang, Changbing, et al.
Pubblicazione: (2025)

The Tokenization Bottleneck: How Vocabulary Extension Improves Chemistry Representation Learning in Pretrained Language Models
di: Kalamkar, Prathamesh, et al.
Pubblicazione: (2025)

Do Vision-Language Models Represent Space and How? Evaluating Spatial Frame of Reference Under Ambiguities
di: Zhang, Zheyuan, et al.
Pubblicazione: (2024)

Phonological Representation Learning for Isolated Signs Improves Out-of-Vocabulary Generalization
di: Kezar, Lee, et al.
Pubblicazione: (2025)

Real Images, Worse Judgments: Evaluating Vision-Language Models on Concreteness and Imagery
di: Jiang, Yifan, et al.
Pubblicazione: (2026)

The First to Know: How Token Distributions Reveal Hidden Knowledge in Large Vision-Language Models?
di: Zhao, Qinyu, et al.
Pubblicazione: (2024)

One Tokenizer To Rule Them All: Emergent Language Plasticity via Multilingual Tokenizers
di: Abagyan, Diana, et al.
Pubblicazione: (2025)

Logical forms complement probability in understanding language model (and human) performance
di: Wang, Yixuan, et al.
Pubblicazione: (2025)

Cross-Linguistic Transcription and Phonological Representation in the Huìtóngguǎnxì Huáyíyìyǔ
di: Kim, Ji-eun
Pubblicazione: (2026)

Barriers to Universal Reasoning With Transformers (And How to Overcome Them)
di: Kraus, Oliver, et al.
Pubblicazione: (2026)

PhonologyBench: Evaluating Phonological Skills of Large Language Models
di: Suvarna, Ashima, et al.
Pubblicazione: (2024)

How Language Directions Align with Token Geometry in Multilingual LLMs
di: Kim, JaeSeong, et al.
Pubblicazione: (2025)

How does a Language-Specific Tokenizer affect LLMs?
di: Seo, Jean, et al.
Pubblicazione: (2025)

How Proficient Are Large Language Models in Formal Languages? An In-Depth Insight for Knowledge Base Question Answering
di: Liu, Jinxin, et al.
Pubblicazione: (2024)

Chartographer: Counterfactual Chart Generation for Evaluating Vision-Language Models
di: Jiang, Yifan, et al.
Pubblicazione: (2026)

Geometry of Semantics in Next-Token Prediction: How Optimization Implicitly Organizes Linguistic Representations
di: Zhao, Yize, et al.
Pubblicazione: (2025)

Enhancing Domain-Specific Encoder Models with LLM-Generated Data: How to Leverage Ontologies, and How to Do Without Them
di: Brinner, Marc, et al.
Pubblicazione: (2025)

How Important Is Tokenization in French Medical Masked Language Models?
di: Labrak, Yanis, et al.
Pubblicazione: (2024)

Blessing of Multilinguality: A Systematic Analysis of Multilingual In-Context Learning
di: Tu, Yilei, et al.
Pubblicazione: (2025)

Phonology Recognition in American Sign Language
di: Tavella, Federico, et al.
Pubblicazione: (2021)

Reasoning Inconsistencies and How to Mitigate Them in Deep Learning
di: Arakelyan, Erik
Pubblicazione: (2025)

LinguaMap: Which Layers of LLMs Speak Your Language and How to Tune Them?
di: Tamo, J. Ben, et al.
Pubblicazione: (2026)

How Large Language Models Balance Internal Knowledge with User and Document Assertions
di: Li, Shuowei, et al.
Pubblicazione: (2026)

TrustJudge: Inconsistencies of LLM-as-a-Judge and How to Alleviate Them
di: Wang, Yidong, et al.
Pubblicazione: (2025)

From Seeing to Thinking: Decoupling Perception and Reasoning Improves Post-Training of Vision-Language Models
di: Wu, Juncheng, et al.
Pubblicazione: (2026)

Liger: Linearizing Large Language Models to Gated Recurrent Structures
di: Lan, Disen, et al.
Pubblicazione: (2025)

Knowledge of Pretrained Language Models on Surface Information of Tokens
di: Hiraoka, Tatsuya, et al.
Pubblicazione: (2024)

Number Cookbook: Number Understanding of Language Models and How to Improve It
di: Yang, Haotong, et al.
Pubblicazione: (2024)

LTD-Bench: Evaluating Large Language Models by Letting Them Draw
di: Lin, Liuhao, et al.
Pubblicazione: (2025)

How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMs
di: Zeng, Yi, et al.
Pubblicazione: (2024)

Tracking the Limits of Knowledge Propagation: How LLMs Fail at Multi-Step Reasoning with Conflicting Knowledge
di: Feng, Yiyang, et al.
Pubblicazione: (2026)

Perception of Phonological Assimilation by Neural Speech Recognition Models
di: Pouw, Charlotte, et al.
Pubblicazione: (2024)

Can Visual Dialogue Models Do Scorekeeping? Exploring How Dialogue Representations Incrementally Encode Shared Knowledge
di: Madureira, Brielen, et al.
Pubblicazione: (2022)

Large Language Models for Predictive Analysis: How Far Are They?
di: Chen, Qin, et al.
Pubblicazione: (2025)

How Language Models Conflate Logical Validity with Plausibility: A Representational Analysis of Content Effects
di: Bertolazzi, Leonardo, et al.
Pubblicazione: (2025)

How Susceptible are Large Language Models to Ideological Manipulation?
di: Chen, Kai, et al.
Pubblicazione: (2024)

Improved Representation Steering for Language Models
di: Wu, Zhengxuan, et al.
Pubblicazione: (2025)

Head-to-Tail: How Knowledgeable are Large Language Models (LLMs)? A.K.A. Will LLMs Replace Knowledge Graphs?
di: Sun, Kai, et al.
Pubblicazione: (2023)