Imagen de Portada

Evaluating the Effectiveness of Linguistic Knowledge in Pretrained Language Models: A Case Study of Universal Dependencies

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autor principal:	Li, Wenxi
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Pretraining Language Models for Diachronic Linguistic Change Discovery
por: Fittschen, Elisabeth, et al.
Publicado: (2025)

Towards Linguistically-informed Representations for English as a Second or Foreign Language: Review, Construction and Application
por: Li, Wenxi, et al.
Publicado: (2026)

DA-Cramming: Enhancing Cost-Effective Language Model Pretraining with Dependency Agreement Integration
por: Kuo, Martin, et al.
Publicado: (2023)

A Comprehensive Evaluation of Semantic Relation Knowledge of Pretrained Language Models and Humans
por: Cao, Zhihan, et al.
Publicado: (2024)

Are Language Models Agnostic to Linguistically Grounded Perturbations? A Case Study of Indic Languages
por: Ghosh, Poulami, et al.
Publicado: (2024)

DatedGPT: Preventing Lookahead Bias in Large Language Models with Time-Aware Pretraining
por: Yan, Yutong, et al.
Publicado: (2026)

Multilingual Knowledge Graph Completion from Pretrained Language Models with Knowledge Constraints
por: Song, Ran, et al.
Publicado: (2024)

Knowledge of Pretrained Language Models on Surface Information of Tokens
por: Hiraoka, Tatsuya, et al.
Publicado: (2024)

Do Language Models Encode Knowledge of Linguistic Constraint Violations?
por: Hardy, et al.
Publicado: (2026)

LMEnt: A Suite for Analyzing Knowledge in Language Models from Pretraining Data to Representations
por: Gottesman, Daniela, et al.
Publicado: (2025)

Decomposed Prompting: Probing Multilingual Linguistic Structure Knowledge in Large Language Models
por: Nie, Ercong, et al.
Publicado: (2024)

Procedural Knowledge in Pretraining Drives Reasoning in Large Language Models
por: Ruis, Laura, et al.
Publicado: (2024)

Multimodal Dialog Systems with Dual Knowledge-enhanced Generative Pretrained Language Model
por: Chen, Xiaolin, et al.
Publicado: (2022)

Knowledge Entropy Decay during Language Model Pretraining Hinders New Knowledge Acquisition
por: Kim, Jiyeon, et al.
Publicado: (2024)

Merging Continual Pretraining Models for Domain-Specialized LLMs: A Case Study in Finance
por: Ueda, Kentaro, et al.
Publicado: (2025)

Discovering Knowledge-Critical Subnetworks in Pretrained Language Models
por: Bayazit, Deniz, et al.
Publicado: (2023)

IKnow: Instruction-Knowledge-Aware Continual Pretraining for Effective Domain Adaptation
por: Zhang, Tianyi, et al.
Publicado: (2025)

Large Language Models as Code Executors: An Exploratory Study
por: Lyu, Chenyang, et al.
Publicado: (2024)

The American Sign Language Knowledge Graph: Infusing ASL Models with Linguistic Knowledge
por: Kezar, Lee, et al.
Publicado: (2024)

Are Large Language Models Effective Knowledge Graph Constructors?
por: Chen, Ruirui, et al.
Publicado: (2025)

Bilingual Evaluation of Language Models on General Knowledge in University Entrance Exams with Minimal Contamination
por: Salido, Eva Sánchez, et al.
Publicado: (2024)

Linguistic Minimal Pairs Elicit Linguistic Similarity in Large Language Models
por: Zhou, Xinyu, et al.
Publicado: (2024)

Linguistically Informed Evaluation of Multilingual ASR for African Languages
por: Chen, Fei-Yueh, et al.
Publicado: (2026)

A Comparison of Language Modeling and Translation as Multilingual Pretraining Objectives
por: Li, Zihao, et al.
Publicado: (2024)

Demographic and Linguistic Bias Evaluation in Omnimodal Language Models
por: Elobaid, Alaa
Publicado: (2026)

Finding Challenging Metaphors that Confuse Pretrained Language Models
por: Li, Yucheng, et al.
Publicado: (2024)

UrBLiMP: A Benchmark for Evaluating the Linguistic Competence of Large Language Models in Urdu
por: Adeeba, Farah, et al.
Publicado: (2025)

CxMP: A Linguistic Minimal-Pair Benchmark for Evaluating Constructional Understanding in Language Models
por: Oba, Miyu, et al.
Publicado: (2026)

Harnessing the Intrinsic Knowledge of Pretrained Language Models for Challenging Text Classification Settings
por: Gao, Lingyu
Publicado: (2024)

Pretraining Language Models Using Translationese
por: Doshi, Meet, et al.
Publicado: (2024)

Geographic Adaptation of Pretrained Language Models
por: Hofmann, Valentin, et al.
Publicado: (2022)

CLEAR: A Comprehensive Linguistic Evaluation of Argument Rewriting by Large Language Models
por: Huber, Thomas, et al.
Publicado: (2025)

XPERT: Expert Knowledge Transfer for Effective Training of Language Models
por: Liu, Chang, et al.
Publicado: (2026)

Dissecting Paraphrases: The Impact of Prompt Syntax and supplementary Information on Knowledge Retrieval from Pretrained Language Models
por: Linzbach, Stephan, et al.
Publicado: (2024)

Language Model Can Do Knowledge Tracing: Simple but Effective Method to Integrate Language Model and Knowledge Tracing Task
por: Lee, Unggi, et al.
Publicado: (2024)

A Family of Pretrained Transformer Language Models for Russian
por: Zmitrovich, Dmitry, et al.
Publicado: (2023)

No Universal Courtesy: A Cross-Linguistic, Multi-Model Study of Politeness Effects on LLMs Using the PLUM Corpus
por: Mehta, Hitesh, et al.
Publicado: (2026)

A Comprehensive Analysis of the Effectiveness of Large Language Models as Automatic Dialogue Evaluators
por: Zhang, Chen, et al.
Publicado: (2023)

Cite Pretrain: Retrieval-Free Knowledge Attribution for Large Language Models
por: Huang, Yukun, et al.
Publicado: (2025)

Can Large Language Models Code Like a Linguist?: A Case Study in Low Resource Sound Law Induction
por: Naik, Atharva, et al.
Publicado: (2024)