Copertina

On the Same Wavelength? Evaluating Pragmatic Reasoning in Language Models across Broad Concepts

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Qiu, Linlu, Zhang, Cedegao E., Tenenbaum, Joshua B., Kim, Yoon, Levy, Roger P.
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Implicit Representations of Grammaticality in Language Models
di: Wang, Yingshan Susan, et al.
Pubblicazione: (2026)

LINC: A Neurosymbolic Approach for Logical Reasoning by Combining Language Models with First-Order Logic Provers
di: Olausson, Theo X., et al.
Pubblicazione: (2023)

Bayesian Teaching Enables Probabilistic Reasoning in Large Language Models
di: Qiu, Linlu, et al.
Pubblicazione: (2025)

Code-enabled language models can outperform reasoning models on diverse tasks
di: Zhang, Cedegao E., et al.
Pubblicazione: (2025)

Language-Informed Synthesis of Rational Agent Models for Grounded Theory-of-Mind Reasoning On-The-Fly
di: Ying, Lance, et al.
Pubblicazione: (2025)

Evaluating Language Models' Evaluations of Games
di: Collins, Katherine M., et al.
Pubblicazione: (2025)

Reasoning or Reciting? Exploring the Capabilities and Limitations of Language Models Through Counterfactual Tasks
di: Wu, Zhaofeng, et al.
Pubblicazione: (2023)

Pragmatic Instruction Following and Goal Assistance via Cooperative Language-Guided Inverse Planning
di: Zhi-Xuan, Tan, et al.
Pubblicazione: (2024)

Scaling up the think-aloud method
di: Wurgaft, Daniel, et al.
Pubblicazione: (2025)

Conditional and Modal Reasoning in Large Language Models
di: Holliday, Wesley H., et al.
Pubblicazione: (2024)

Is Safety Standard Same for Everyone? User-Specific Safety Evaluation of Large Language Models
di: In, Yeonjun, et al.
Pubblicazione: (2025)

Same Task, More Tokens: the Impact of Input Length on the Reasoning Performance of Large Language Models
di: Levy, Mosh, et al.
Pubblicazione: (2024)

Finding structure in logographic writing with library learning
di: Jiang, Guangyuan, et al.
Pubblicazione: (2024)

Neuro-Symbolic Concepts
di: Mao, Jiayuan, et al.
Pubblicazione: (2025)

Controlled Evaluation of Syntactic Knowledge in Multilingual Language Models
di: Kryvosheieva, Daria, et al.
Pubblicazione: (2024)

CEI: A Benchmark for Evaluating Pragmatic Reasoning in Language Models
di: Chun, Jon, et al.
Pubblicazione: (2026)

Phenomenal Yet Puzzling: Testing Inductive Reasoning Capabilities of Language Models with Hypothesis Refinement
di: Qiu, Linlu, et al.
Pubblicazione: (2023)

Evaluating Pragmatic Reasoning in Large Language Models: Evidence from Scalar Diversity
di: Cho, Ye-eun
Pubblicazione: (2026)

Lookback Lens: Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Maps
di: Chuang, Yung-Sung, et al.
Pubblicazione: (2024)

Diagnosing Moral Reasoning Acquisition in Language Models: Pragmatics and Generalization
di: Liu, Guangliang, et al.
Pubblicazione: (2025)

Hypothesis-Driven Theory-of-Mind Reasoning for Large Language Models
di: Kim, Hyunwoo, et al.
Pubblicazione: (2025)

Pragmatic Competence Evaluation of Large Language Models for the Korean Language
di: Park, Dojun, et al.
Pubblicazione: (2024)

Learning to Reason via Program Generation, Emulation, and Search
di: Weir, Nathaniel, et al.
Pubblicazione: (2024)

Accounting Reasoning in Large Language Models: Concepts, Evaluation, and Empirical Analysis
di: Zhou, Jie, et al.
Pubblicazione: (2025)

Modeling Open-World Cognition as On-Demand Synthesis of Probabilistic Models
di: Wong, Lionel, et al.
Pubblicazione: (2025)

ELF: Embedded Language Flows
di: Hu, Keya, et al.
Pubblicazione: (2026)

N-gram-like Language Models Predict Reading Time Best
di: Michaelov, James A., et al.
Pubblicazione: (2026)

AmbigDocs: Reasoning across Documents on Different Entities under the Same Name
di: Lee, Yoonsang, et al.
Pubblicazione: (2024)

Towards an Analysis of Discourse and Interactional Pragmatic Reasoning Capabilities of Large Language Models
di: Robrecht, Amelie, et al.
Pubblicazione: (2024)

Evaluating Large Vision-and-Language Models on Children's Mathematical Olympiads
di: Cherian, Anoop, et al.
Pubblicazione: (2024)

MultiPragEval: Multilingual Pragmatic Evaluation of Large Language Models
di: Park, Dojun, et al.
Pubblicazione: (2024)

M3-SLU: Evaluating Speaker-Attributed Reasoning in Multimodal Large Language Models
di: Kwon, Yejin, et al.
Pubblicazione: (2025)

Self-Steering Language Models
di: Grand, Gabriel, et al.
Pubblicazione: (2025)

RPM: Reasoning-Level Personalization for Black-Box Large Language Models
di: Kim, Jieyong, et al.
Pubblicazione: (2025)

Bias Amplification in Language Model Evolution: An Iterated Learning Perspective
di: Ren, Yi, et al.
Pubblicazione: (2024)

The Pragmatic Mind of Machines: Tracing the Emergence of Pragmatic Competence in Large Language Models
di: Yu, Kefan, et al.
Pubblicazione: (2025)

Loose LIPS Sink Ships: Asking Questions in Battleship with Language-Informed Program Sampling
di: Grand, Gabriel, et al.
Pubblicazione: (2024)

On Emergent Social World Models -- Evidence for Functional Integration of Theory of Mind and Pragmatic Reasoning in Language Models
di: Tsvilodub, Polina, et al.
Pubblicazione: (2026)

STAR: A Benchmark for Situated Reasoning in Real-World Videos
di: Wu, Bo, et al.
Pubblicazione: (2024)

Pragmatics in the Era of Large Language Models: A Survey on Datasets, Evaluation, Opportunities and Challenges
di: Ma, Bolei, et al.
Pubblicazione: (2025)