Copertina

Reasoning or Reciting? Exploring the Capabilities and Limitations of Language Models Through Counterfactual Tasks

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Wu, Zhaofeng, Qiu, Linlu, Ross, Alexis, Akyürek, Ekin, Chen, Boyuan, Wang, Bailin, Kim, Najoung, Andreas, Jacob, Kim, Yoon
Natura:	Preprint
Pubblicazione:	2023
Soggetti:	Computation and Language Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

In-Context Language Learning: Architectures and Algorithms
di: Akyürek, Ekin, et al.
Pubblicazione: (2024)

The Surprising Effectiveness of Test-Time Training for Few-Shot Learning
di: Akyürek, Ekin, et al.
Pubblicazione: (2024)

Deductive Closure Training of Language Models for Coherence, Accuracy, and Updatability
di: Akyürek, Afra Feyza, et al.
Pubblicazione: (2024)

Implicit Representations of Grammaticality in Language Models
di: Wang, Yingshan Susan, et al.
Pubblicazione: (2026)

Phenomenal Yet Puzzling: Testing Inductive Reasoning Capabilities of Language Models with Hypothesis Refinement
di: Qiu, Linlu, et al.
Pubblicazione: (2023)

On the Same Wavelength? Evaluating Pragmatic Reasoning in Language Models across Broad Concepts
di: Qiu, Linlu, et al.
Pubblicazione: (2025)

Is Active Persona Inference Necessary for Aligning Small Models to Personal Preferences?
di: Tang, Zilu, et al.
Pubblicazione: (2025)

Bayesian Teaching Enables Probabilistic Reasoning in Large Language Models
di: Qiu, Linlu, et al.
Pubblicazione: (2025)

Is analogy enough to draw novel adjective-noun inferences?
di: Ross, Hayley, et al.
Pubblicazione: (2025)

Is artificial intelligence still intelligence? LLMs generalize to novel adjective-noun pairs, but don't mimic the full human distribution
di: Ross, Hayley, et al.
Pubblicazione: (2024)

ELF: Embedded Language Flows
di: Hu, Keya, et al.
Pubblicazione: (2026)

Bias Amplification in Language Model Evolution: An Iterated Learning Perspective
di: Ren, Yi, et al.
Pubblicazione: (2024)

A systematic framework for generating novel experimental hypotheses from language models
di: Misra, Kanishka, et al.
Pubblicazione: (2024)

Code Pretraining Improves Entity Tracking Abilities of Language Models
di: Kim, Najoung, et al.
Pubblicazione: (2024)

Translation or Recitation? Calibrating Evaluation Scores for Machine Translation of Extremely Low-Resource Languages
di: Chen, Danlu, et al.
Pubblicazione: (2026)

Can You Learn Semantics Through Next-Word Prediction? The Case of Entailment
di: Merrill, William, et al.
Pubblicazione: (2024)

Reuse Your Rewards: Reward Model Transfer for Zero-Shot Cross-Lingual Alignment
di: Wu, Zhaofeng, et al.
Pubblicazione: (2024)

Learning Linear Attention in Polynomial Time
di: Yau, Morris, et al.
Pubblicazione: (2024)

Syn-QA2: Evaluating False Assumptions in Long-tail Questions with Synthetic QA Datasets
di: Daswani, Ashwin, et al.
Pubblicazione: (2024)

The Semantic Hub Hypothesis: Language Models Share Semantic Representations Across Languages and Modalities
di: Wu, Zhaofeng, et al.
Pubblicazione: (2024)

Structured Code Representations Enable Data-Efficient Adaptation of Code Language Models
di: Agarwal, Mayank, et al.
Pubblicazione: (2024)

Lookback Lens: Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Maps
di: Chuang, Yung-Sung, et al.
Pubblicazione: (2024)

Self-Adapting Language Models
di: Zweiger, Adam, et al.
Pubblicazione: (2025)

Toward In-Context Teaching: Adapting Examples to Students' Misconceptions
di: Ross, Alexis, et al.
Pubblicazione: (2024)

Learning to Decode Collaboratively with Multiple Language Models
di: Shen, Shannon Zejiang, et al.
Pubblicazione: (2024)

DrawingBench: Evaluating Spatial Reasoning and UI Interaction Capabilities of Large Language Models through Mouse-Based Drawing Tasks
di: Kim, Hyunjun, et al.
Pubblicazione: (2025)

Reaching Beyond the Mode: RL for Distributional Reasoning in Language Models
di: Puri, Isha, et al.
Pubblicazione: (2026)

Findings of the BlackboxNLP 2025 Shared Task: Localizing Circuits and Causal Variables in Language Models
di: Arad, Dana, et al.
Pubblicazione: (2025)

Are they lovers or friends? Evaluating LLMs' Social Reasoning in English and Korean Dialogues
di: Kim, Eunsu, et al.
Pubblicazione: (2025)

Personas as a Way to Model Truthfulness in Language Models
di: Joshi, Nitish, et al.
Pubblicazione: (2023)

CHAMP: A Competition-level Dataset for Fine-Grained Analyses of LLMs' Mathematical Reasoning Capabilities
di: Mao, Yujun, et al.
Pubblicazione: (2024)

RPM: Reasoning-Level Personalization for Black-Box Large Language Models
di: Kim, Jieyong, et al.
Pubblicazione: (2025)

Learning to Reason via Program Generation, Emulation, and Search
di: Weir, Nathaniel, et al.
Pubblicazione: (2024)

Towards Efficient Visual-Language Alignment of the Q-Former for Visual Reasoning Tasks
di: Kim, Sungkyung, et al.
Pubblicazione: (2024)

Reinforcement Learning vs. Distillation: Understanding Accuracy and Capability in LLM Reasoning
di: Kim, Minwu, et al.
Pubblicazione: (2025)

Phi-4-Mini-Reasoning: Exploring the Limits of Small Reasoning Language Models in Math
di: Xu, Haoran, et al.
Pubblicazione: (2025)

Gated Linear Attention Transformers with Hardware-Efficient Training
di: Yang, Songlin, et al.
Pubblicazione: (2023)

Parallelizing Linear Transformers with the Delta Rule over Sequence Length
di: Yang, Songlin, et al.
Pubblicazione: (2024)

The Dialogue That Heals: A Comprehensive Evaluation of Doctor Agents' Inquiry Capability
di: Gong, Linlu, et al.
Pubblicazione: (2025)

Reasoning Capabilities of Large Language Models on Dynamic Tasks
di: Wong, Annie, et al.
Pubblicazione: (2025)