Cover Image

Log Probabilities Are a Reliable Estimate of Semantic Plausibility in Base and Instruction-Tuned Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Kauf, Carina, Chersoni, Emmanuele, Lenci, Alessandro, Fedorenko, Evelina, Ivanova, Anna A.
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Empirical Sufficiency Lower Bounds for Language Modeling with Locally-Bootstrapped Semantic Structures
by: Prange, Jakob, et al.
Published: (2023)

ExpliCa: Evaluating Explicit Causal Reasoning in Large Language Models
by: Miliani, Martina, et al.
Published: (2025)

Lexicon-Level Contrastive Visual-Grounding Improves Language Modeling
by: Zhuang, Chengxu, et al.
Published: (2024)

Representational Curvature Modulates Behavioral Uncertainty in Large Language Models
by: King, Jack, et al.
Published: (2026)

Composing or Not Composing? Towards Distributional Construction Grammars
by: Blache, Philippe, et al.
Published: (2024)

Do LLMs Capture Embodied Cognition and Cultural Variation? Cross-Linguistic Evidence from Demonstratives
by: Wang, Yu, et al.
Published: (2026)

Dissociating language and thought in large language models
by: Mahowald, Kyle, et al.
Published: (2023)

Visual Grounding Helps Learn Word Meanings in Low-Data Regimes
by: Zhuang, Chengxu, et al.
Published: (2023)

Elements of World Knowledge (EWoK): A Cognition-Inspired Framework for Evaluating Basic World Knowledge in Language Models
by: Ivanova, Anna A., et al.
Published: (2024)

Estimating Commonsense Plausibility through Semantic Shifts
by: Cui, Wanqing, et al.
Published: (2025)

What does it mean to understand language?
by: Casto, Colton, et al.
Published: (2025)

How Reliable Are Automatic Evaluation Methods for Instruction-Tuned LLMs?
by: Doostmohammadi, Ehsan, et al.
Published: (2024)

Toward best research practices in AI Psychology
by: Ivanova, Anna A.
Published: (2023)

Neural Generative Models and the Parallel Architecture of Language: A Critical Review and Outlook
by: Giulia Rambelli, et al.
Published: (2024)

Mind the Gap: Conformative Decoding to Improve Output Diversity of Instruction-Tuned Large Language Models
by: Peeperkorn, Max, et al.
Published: (2025)

Phased Instruction Fine-Tuning for Large Language Models
by: Pang, Wei, et al.
Published: (2024)

Investigating Instruction Tuning Large Language Models on Graphs
by: Zhu, Kerui, et al.
Published: (2024)

Revisiting the Reliability of Language Models in Instruction-Following
by: Dong, Jianshuo, et al.
Published: (2025)

CLASS-IT: Conversational and Lecture-Aligned Small-Scale Instruction Tuning for BabyLMs
by: Capone, Luca, et al.
Published: (2025)

GraphGPT: Graph Instruction Tuning for Large Language Models
by: Tang, Jiabin, et al.
Published: (2023)

Towards Robust Instruction Tuning on Multimodal Large Language Models
by: Han, Wei, et al.
Published: (2024)

OctoPack: Instruction Tuning Code Large Language Models
by: Muennighoff, Niklas, et al.
Published: (2023)

Optimizing Psychological Counseling with Instruction-Tuned Large Language Models
by: Li, Wenjie, et al.
Published: (2024)

Is This Just Fantasy? Language Model Representations Reflect Human Judgments of Event Plausibility
by: Lepori, Michael A., et al.
Published: (2025)

Position Paper On Diagnostic Uncertainty Estimation from Large Language Models: Next-Word Probability Is Not Pre-test Probability
by: Gao, Yanjun, et al.
Published: (2024)

Plausibility as Commonsense Reasoning: Humans Succeed, Large Language Models Do not
by: Karakaş, Sercan
Published: (2026)

Plausibility Vaccine: Injecting LLM Knowledge for Event Plausibility
by: Chmura, Jacob, et al.
Published: (2025)

Instruction Mining: Instruction Data Selection for Tuning Large Language Models
by: Cao, Yihan, et al.
Published: (2023)

BioInstruct: Instruction Tuning of Large Language Models for Biomedical Natural Language Processing
by: Tran, Hieu, et al.
Published: (2023)

LongForm: Effective Instruction Tuning with Reverse Instructions
by: Köksal, Abdullatif, et al.
Published: (2023)

MURI: High-Quality Instruction Tuning Datasets for Low-Resource Languages via Reverse Instructions
by: Köksal, Abdullatif, et al.
Published: (2024)

Vikhr: The Family of Open-Source Instruction-Tuned Large Language Models for Russian
by: Nikolich, Aleksandr, et al.
Published: (2024)

Graph-oriented Instruction Tuning of Large Language Models for Generic Graph Mining
by: Tan, Yanchao, et al.
Published: (2024)

Cross-Lingual Stability and Bias in Instruction-Tuned Language Models for Humanitarian NLP
by: Nemkova, Poli, et al.
Published: (2025)

EXAONE 3.0 7.8B Instruction Tuned Language Model
by: An, Soyoung, et al.
Published: (2024)

Toward Graph-Tokenizing Large Language Models with Reconstructive Graph Instruction Tuning
by: Zhang, Zhongjian, et al.
Published: (2026)

Merging Triggers, Breaking Backdoors: Defensive Poisoning for Instruction-Tuned Language Models
by: Kim, San, et al.
Published: (2026)

Instruction Tuning for Large Language Models: A Survey
by: Zhang, Shengyu, et al.
Published: (2023)

Semantic Consistency for Assuring Reliability of Large Language Models
by: Raj, Harsh, et al.
Published: (2023)

Instruction Tuning With Loss Over Instructions
by: Shi, Zhengyan, et al.
Published: (2024)