Imagen de Portada

Creating ConLangs to Probe the Metalinguistic Grammatical Knowledge of LLMs

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Taguchi, Chihiro, Sproat, Richard
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Building Tailored Speech Recognizers for Japanese Speaking Assessment
por: Kubo, Yotaro, et al.
Publicado: (2025)

A Benchmark for the Detection of Metalinguistic Disagreements between LLMs and Knowledge Graphs
por: Allen, Bradley P., et al.
Publicado: (2025)

Language Complexity and Speech Recognition Accuracy: Orthographic Complexity Hurts, Phonological Complexity Doesn't
por: Taguchi, Chihiro, et al.
Publicado: (2024)

TransEvalnia: Reasoning-based Evaluation and Ranking of Translations
por: Sproat, Richard, et al.
Publicado: (2025)

Probing for the Usage of Grammatical Number
por: Lasri, Karim, et al.
Publicado: (2022)

The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang
por: Liu, Fenghua, et al.
Publicado: (2025)

Evaluating Metalinguistic Knowledge in Large Language Models across the World's Languages
por: Arčon, Tjaša, et al.
Publicado: (2026)

How to Make the Most of LLMs' Grammatical Knowledge for Acceptability Judgments
por: Ide, Yusuke, et al.
Publicado: (2024)

Automatic Speech Recognition for Documenting Endangered Languages: Case Study of Ikema Miyakoan
por: Taguchi, Chihiro, et al.
Publicado: (2026)

Enhancing Grammatical Error Detection using BERT with Cleaned Lang-8 Dataset
por: Nihalani, Rahul, et al.
Publicado: (2024)

Efficient Context Selection for Long-Context QA: No Tuning, No Iteration, Just Adaptive-$k$
por: Taguchi, Chihiro, et al.
Publicado: (2025)

ChatLang-8: An LLM-Based Synthetic Data Generation Framework for Grammatical Error Correction
por: Park, Jeiyoon, et al.
Publicado: (2024)

Killkan: The Automatic Speech Recognition Dataset for Kichwa with Morphosyntactic Information
por: Taguchi, Chihiro, et al.
Publicado: (2024)

Multi-Dimensional Evaluation of LLMs for Grammatical Error Correction
por: Labib, Adnan, et al.
Publicado: (2026)

LangVAE and LangSpace: Building and Probing for Language Model VAEs
por: Carvalho, Danilo S., et al.
Publicado: (2025)

Poisoned LangChain: Jailbreak LLMs by LangChain
por: Wang, Ziqiu, et al.
Publicado: (2024)

RePo: Language Models with Context Re-Positioning
por: Li, Huayang, et al.
Publicado: (2025)

Towards Corpus-Grounded Agentic LLMs for Multilingual Grammatical Analysis
por: Klemen, Matej, et al.
Publicado: (2025)

Adapting LLMs for Minimal-edit Grammatical Error Correction
por: Staruch, Ryszard, et al.
Publicado: (2025)

Grammaticality Judgments in Humans and Language Models: Revisiting Generative Grammar with LLMs
por: Johnsen, Lars G. B.
Publicado: (2025)

Can Language Models Induce Grammatical Knowledge from Indirect Evidence?
por: Oba, Miyu, et al.
Publicado: (2024)

I am a Strange Dataset: Metalinguistic Tests for Language Models
por: Thrush, Tristan, et al.
Publicado: (2024)

Organic Data-Driven Approach for Turkish Grammatical Error Correction and LLMs
por: Ersoy, Asım, et al.
Publicado: (2024)

Demystifying Scientific Problem-Solving in LLMs by Probing Knowledge and Reasoning
por: Li, Alan, et al.
Publicado: (2025)

Why Does New Knowledge Create Messy Ripple Effects in LLMs?
por: Qin, Jiaxin, et al.
Publicado: (2024)

SoftMatcha: A Soft and Fast Pattern Matcher for Billion-Scale Corpus Searches
por: Deguchi, Hiroyuki, et al.
Publicado: (2025)

GRADE: Probing Knowledge Gaps in LLMs through Gradient Subspace Dynamics
por: Wang, Yujing, et al.
Publicado: (2026)

MultifacetEval: Multifaceted Evaluation to Probe LLMs in Mastering Medical Knowledge
por: Zhou, Yuxuan, et al.
Publicado: (2024)

Revisiting Classification Taxonomy for Grammatical Errors
por: Zou, Deqing, et al.
Publicado: (2025)

Implicit Representations of Grammaticality in Language Models
por: Wang, Yingshan Susan, et al.
Publicado: (2026)

EtCon: Edit-then-Consolidate for Reliable Knowledge Editing
por: Li, Ruilin, et al.
Publicado: (2025)

Layer-wise Minimal Pair Probing Reveals Contextual Grammatical-Conceptual Hierarchy in Speech Representations
por: He, Linyang, et al.
Publicado: (2025)

Chinese Grammatical Error Correction: A Survey
por: Qiu, Mengyang, et al.
Publicado: (2025)

ConTextual: Improving Clinical Text Summarization in LLMs with Context-preserving Token Filtering and Knowledge Graphs
por: Piya, Fahmida Liza, et al.
Publicado: (2025)

Automatic Annotation of Grammaticality in Child-Caregiver Conversations
por: Nikolaus, Mitja, et al.
Publicado: (2024)

Revisiting Meta-evaluation for Grammatical Error Correction
por: Kobayashi, Masamune, et al.
Publicado: (2024)

The Causal Influence of Grammatical Gender on Distributional Semantics
por: Stańczak, Karolina, et al.
Publicado: (2023)

IMPARA-GED: Grammatical Error Detection is Boosting Reference-free Grammatical Error Quality Estimator
por: Sakai, Yusuke, et al.
Publicado: (2025)

Towards Grammatical Tagging for the Legal Language of Cybersecurity
por: Castiglione, Gianpietro, et al.
Publicado: (2023)

Does Mapo Tofu Contain Coffee? Probing LLMs for Food-related Cultural Knowledge
por: Zhou, Li, et al.
Publicado: (2024)