Copertina

Competence-Based Analysis of Language Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Davies, Adam, Jiang, Jize, Zhai, ChengXiang
Natura:	Preprint
Pubblicazione:	2023
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

TinyHelen's First Curriculum: Training and Evaluating Tiny Language Models in a Simpler Language Environment
di: Yang, Ke, et al.
Pubblicazione: (2024)

An Investigation of Robustness of LLMs in Mathematical Reasoning: Benchmarking with Mathematically-Equivalent Transformation of Advanced Mathematical Problems
di: Hao, Yuren, et al.
Pubblicazione: (2025)

Bias and Volatility: A Statistical Framework for Evaluating Large Language Model's Stereotypes and the Associated Generation Inconsistency
di: Liu, Yiran, et al.
Pubblicazione: (2024)

Beyond Reactive Safety: Risk-Aware LLM Alignment via Long-Horizon Simulation
di: Sun, Chenkai, et al.
Pubblicazione: (2025)

PlugMem: A Task-Agnostic Plugin Memory Module for LLM Agents
di: Yang, Ke, et al.
Pubblicazione: (2026)

User Preference Modeling for Conversational LLM Agents: Weak Rewards from Retrieval-Augmented Interaction
di: Hao, Yuren, et al.
Pubblicazione: (2026)

User Simulation in the Era of Generative AI: User Modeling, Synthetic Data Generation, and System Evaluation
di: Balog, Krisztian, et al.
Pubblicazione: (2025)

User Simulation for Evaluating Information Access Systems
di: Balog, Krisztian, et al.
Pubblicazione: (2023)

Persona-DB: Efficient Large Language Model Personalization for Response Prediction with Collaborative Data Refinement
di: Sun, Chenkai, et al.
Pubblicazione: (2024)

Seed-Guided Fine-Grained Entity Typing in Science and Engineering Domains
di: Zhang, Yu, et al.
Pubblicazione: (2024)

Blackbird Language Matrices: A Framework to Investigate the Linguistic Competence of Language Models
di: Merlo, Paola, et al.
Pubblicazione: (2026)

Globally Optimal Training of Spiking Neural Networks via Parameter Reconstruction
di: Udupi, Himanshu, et al.
Pubblicazione: (2026)

Benchmarking Multi-turn Medical Diagnosis: Hold, Lure, and Self-Correction
di: Fang, Jinrui, et al.
Pubblicazione: (2026)

Evaluating the Deductive Competence of Large Language Models
di: Seals, Spencer M., et al.
Pubblicazione: (2023)

Traces of Social Competence in Large Language Models
di: Kouwenhoven, Tom, et al.
Pubblicazione: (2026)

MentalGLM Series: Explainable Large Language Models for Mental Health Analysis on Chinese Social Media
di: Zhai, Wei, et al.
Pubblicazione: (2024)

Pragmatic Competence Evaluation of Large Language Models for the Korean Language
di: Park, Dojun, et al.
Pubblicazione: (2024)

Benchmarking Motivational Interviewing Competence of Large Language Models
di: Jha, Aishwariya, et al.
Pubblicazione: (2026)

Decomposition for Enhancing Attention: Improving LLM-based Text-to-SQL through Workflow Paradigm
di: Xie, Yuanzhen, et al.
Pubblicazione: (2024)

Extrinsic Evaluation of Cultural Competence in Large Language Models
di: Bhatt, Shaily, et al.
Pubblicazione: (2024)

Ten Principles of AI Agent Economics
di: Yang, Ke, et al.
Pubblicazione: (2025)

The Indispensable Role of User Simulation in the Pursuit of AGI
di: Balog, Krisztian, et al.
Pubblicazione: (2025)

An Axiomatic Benchmark for Evaluation of Scientific Novelty Metrics
di: Liu, Miri, et al.
Pubblicazione: (2026)

Exploring a New Competency Modeling Process with Large Language Models
di: Du, Silin, et al.
Pubblicazione: (2026)

Vision-Language Models Are Not Pragmatically Competent in Referring Expression Generation
di: Ma, Ziqiao, et al.
Pubblicazione: (2025)

Holmes: A Benchmark to Assess the Linguistic Competence of Language Models
di: Waldis, Andreas, et al.
Pubblicazione: (2024)

Evaluation of Cultural Competence of Vision-Language Models
di: Yadav, Srishti, et al.
Pubblicazione: (2025)

Flash Interpretability: Decoding Specialised Feature Neurons in Large Language Models with the LM-Head
di: Davies, Harry J
Pubblicazione: (2025)

Enhancing Linguistic Competence of Language Models through Pre-training with Language Learning Tasks
di: Yamaguchi, Atsuki, et al.
Pubblicazione: (2026)

Large Language Models as Neurolinguistic Subjects: Discrepancy between Performance and Competence
di: He, Linyang, et al.
Pubblicazione: (2024)

Scaling Competence, Shrinking Reasoning: Cognitive Signatures in Language Model Learning
di: Singh, Mukul, et al.
Pubblicazione: (2025)

Unveiling Language Competence Neurons: A Psycholinguistic Approach to Model Interpretability
di: Duan, Xufeng, et al.
Pubblicazione: (2024)

A Lightweight Large Language Model-Based Multi-Agent System for 2D Frame Structural Analysis
di: Geng, Ziheng, et al.
Pubblicazione: (2025)

A Novel Psychometrics-Based Approach to Developing Professional Competency Benchmark for Large Language Models
di: Kardanova, Elena, et al.
Pubblicazione: (2024)

The Pragmatic Mind of Machines: Tracing the Emergence of Pragmatic Competence in Large Language Models
di: Yu, Kefan, et al.
Pubblicazione: (2025)

BLiSS 1.0: Evaluating Bilingual Learner Competence in Second Language Small Language Models
di: Gao, Yuan, et al.
Pubblicazione: (2025)

Evaluating Clinical Competencies of Large Language Models with a General Practice Benchmark
di: Li, Zheqing, et al.
Pubblicazione: (2025)

Foundation Models for Low-Resource Language Education (Vision Paper)
di: Ding, Zhaojun, et al.
Pubblicazione: (2024)

Automated Analysis of Sustainability Reports: Using Large Language Models for the Extraction and Prediction of EU Taxonomy-Compliant KPIs
di: Schmoll, Jonathan, et al.
Pubblicazione: (2025)

Are Multimodal Large Language Models Pragmatically Competent Listeners in Simple Reference Resolution Tasks?
di: Junker, Simeon, et al.
Pubblicazione: (2025)