Image de couverture de livre

Evaluating the Effectiveness of Linguistic Knowledge in Pretrained Language Models: A Case Study of Universal Dependencies

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteur principal:	Li, Wenxi
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Pretraining Language Models for Diachronic Linguistic Change Discovery
par: Fittschen, Elisabeth, et autres
Publié: (2025)

Towards Linguistically-informed Representations for English as a Second or Foreign Language: Review, Construction and Application
par: Li, Wenxi, et autres
Publié: (2026)

DA-Cramming: Enhancing Cost-Effective Language Model Pretraining with Dependency Agreement Integration
par: Kuo, Martin, et autres
Publié: (2023)

A Comprehensive Evaluation of Semantic Relation Knowledge of Pretrained Language Models and Humans
par: Cao, Zhihan, et autres
Publié: (2024)

Are Language Models Agnostic to Linguistically Grounded Perturbations? A Case Study of Indic Languages
par: Ghosh, Poulami, et autres
Publié: (2024)

DatedGPT: Preventing Lookahead Bias in Large Language Models with Time-Aware Pretraining
par: Yan, Yutong, et autres
Publié: (2026)

Multilingual Knowledge Graph Completion from Pretrained Language Models with Knowledge Constraints
par: Song, Ran, et autres
Publié: (2024)

Knowledge of Pretrained Language Models on Surface Information of Tokens
par: Hiraoka, Tatsuya, et autres
Publié: (2024)

Do Language Models Encode Knowledge of Linguistic Constraint Violations?
par: Hardy, et autres
Publié: (2026)

LMEnt: A Suite for Analyzing Knowledge in Language Models from Pretraining Data to Representations
par: Gottesman, Daniela, et autres
Publié: (2025)

Decomposed Prompting: Probing Multilingual Linguistic Structure Knowledge in Large Language Models
par: Nie, Ercong, et autres
Publié: (2024)

Procedural Knowledge in Pretraining Drives Reasoning in Large Language Models
par: Ruis, Laura, et autres
Publié: (2024)

Multimodal Dialog Systems with Dual Knowledge-enhanced Generative Pretrained Language Model
par: Chen, Xiaolin, et autres
Publié: (2022)

Knowledge Entropy Decay during Language Model Pretraining Hinders New Knowledge Acquisition
par: Kim, Jiyeon, et autres
Publié: (2024)

Merging Continual Pretraining Models for Domain-Specialized LLMs: A Case Study in Finance
par: Ueda, Kentaro, et autres
Publié: (2025)

Discovering Knowledge-Critical Subnetworks in Pretrained Language Models
par: Bayazit, Deniz, et autres
Publié: (2023)

IKnow: Instruction-Knowledge-Aware Continual Pretraining for Effective Domain Adaptation
par: Zhang, Tianyi, et autres
Publié: (2025)

Large Language Models as Code Executors: An Exploratory Study
par: Lyu, Chenyang, et autres
Publié: (2024)

The American Sign Language Knowledge Graph: Infusing ASL Models with Linguistic Knowledge
par: Kezar, Lee, et autres
Publié: (2024)

Are Large Language Models Effective Knowledge Graph Constructors?
par: Chen, Ruirui, et autres
Publié: (2025)

Bilingual Evaluation of Language Models on General Knowledge in University Entrance Exams with Minimal Contamination
par: Salido, Eva Sánchez, et autres
Publié: (2024)

Linguistic Minimal Pairs Elicit Linguistic Similarity in Large Language Models
par: Zhou, Xinyu, et autres
Publié: (2024)

Linguistically Informed Evaluation of Multilingual ASR for African Languages
par: Chen, Fei-Yueh, et autres
Publié: (2026)

A Comparison of Language Modeling and Translation as Multilingual Pretraining Objectives
par: Li, Zihao, et autres
Publié: (2024)

Demographic and Linguistic Bias Evaluation in Omnimodal Language Models
par: Elobaid, Alaa
Publié: (2026)

Finding Challenging Metaphors that Confuse Pretrained Language Models
par: Li, Yucheng, et autres
Publié: (2024)

UrBLiMP: A Benchmark for Evaluating the Linguistic Competence of Large Language Models in Urdu
par: Adeeba, Farah, et autres
Publié: (2025)

CxMP: A Linguistic Minimal-Pair Benchmark for Evaluating Constructional Understanding in Language Models
par: Oba, Miyu, et autres
Publié: (2026)

Harnessing the Intrinsic Knowledge of Pretrained Language Models for Challenging Text Classification Settings
par: Gao, Lingyu
Publié: (2024)

Pretraining Language Models Using Translationese
par: Doshi, Meet, et autres
Publié: (2024)

Geographic Adaptation of Pretrained Language Models
par: Hofmann, Valentin, et autres
Publié: (2022)

CLEAR: A Comprehensive Linguistic Evaluation of Argument Rewriting by Large Language Models
par: Huber, Thomas, et autres
Publié: (2025)

XPERT: Expert Knowledge Transfer for Effective Training of Language Models
par: Liu, Chang, et autres
Publié: (2026)

Dissecting Paraphrases: The Impact of Prompt Syntax and supplementary Information on Knowledge Retrieval from Pretrained Language Models
par: Linzbach, Stephan, et autres
Publié: (2024)

Language Model Can Do Knowledge Tracing: Simple but Effective Method to Integrate Language Model and Knowledge Tracing Task
par: Lee, Unggi, et autres
Publié: (2024)

A Family of Pretrained Transformer Language Models for Russian
par: Zmitrovich, Dmitry, et autres
Publié: (2023)

No Universal Courtesy: A Cross-Linguistic, Multi-Model Study of Politeness Effects on LLMs Using the PLUM Corpus
par: Mehta, Hitesh, et autres
Publié: (2026)

A Comprehensive Analysis of the Effectiveness of Large Language Models as Automatic Dialogue Evaluators
par: Zhang, Chen, et autres
Publié: (2023)

Cite Pretrain: Retrieval-Free Knowledge Attribution for Large Language Models
par: Huang, Yukun, et autres
Publié: (2025)

Can Large Language Models Code Like a Linguist?: A Case Study in Low Resource Sound Law Induction
par: Naik, Atharva, et autres
Publié: (2024)