Imagen de Portada

Using Counterfactual Tasks to Evaluate the Generality of Analogical Reasoning in Large Language Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Lewis, Martha, Mitchell, Melanie
Formato:	Preprint
Publicado:	2024
Materias:	Artificial Intelligence Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Evaluating the Robustness of Analogical Reasoning in Large Language Models
por: Lewis, Martha, et al.
Publicado: (2024)

Counterfactual Simulatability of LLM Explanations for Generation Tasks
por: Limpijankit, Marvin, et al.
Publicado: (2025)

Reasoning or Reciting? Exploring the Capabilities and Limitations of Language Models Through Counterfactual Tasks
por: Wu, Zhaofeng, et al.
Publicado: (2023)

Natural Language Counterfactual Explanations for Graphs Using Large Language Models
por: Giorgi, Flavio, et al.
Publicado: (2024)

Thought Propagation: An Analogical Approach to Complex Reasoning with Large Language Models
por: Yu, Junchi, et al.
Publicado: (2023)

Modeling Understanding of Story-Based Analogies Using Large Language Models
por: Inani, Kalit, et al.
Publicado: (2025)

COFT: Counterfactual-Conformal Decoding for Fair Chain-of-Thought Reasoning in Large Language Models
por: Fayyazi, Arya, et al.
Publicado: (2026)

Counterfactual Token Generation in Large Language Models
por: Chatzi, Ivi, et al.
Publicado: (2024)

RFEval: Benchmarking Reasoning Faithfulness under Counterfactual Reasoning Intervention in Large Reasoning Models
por: Han, Yunseok, et al.
Publicado: (2026)

Reasoning Capabilities of Large Language Models on Dynamic Tasks
por: Wong, Annie, et al.
Publicado: (2025)

General365: Benchmarking General Reasoning in Large Language Models Across Diverse and Challenging Tasks
por: Liu, Junlin, et al.
Publicado: (2026)

Aligning Large Language Models with Counterfactual DPO
por: Butcher, Bradley
Publicado: (2024)

Large Language Models as Theory of Mind Aware Generative Agents with Counterfactual Reflection
por: Yang, Bo, et al.
Publicado: (2025)

DyVal: Dynamic Evaluation of Large Language Models for Reasoning Tasks
por: Zhu, Kaijie, et al.
Publicado: (2023)

Eliciting Causal Abilities in Large Language Models for Reasoning Tasks
por: Wang, Yajing, et al.
Publicado: (2024)

An Evaluation of Large Language Models on Text Summarization Tasks Using Prompt Engineering Techniques
por: Aly, Walid Mohamed, et al.
Publicado: (2025)

CLOMO: Counterfactual Logical Modification with Large Language Models
por: Huang, Yinya, et al.
Publicado: (2023)

Towards Unifying Evaluation of Counterfactual Explanations: Leveraging Large Language Models for Human-Centric Assessments
por: Domnich, Marharyta, et al.
Publicado: (2024)

FRoG: Evaluating Fuzzy Reasoning of Generalized Quantifiers in Large Language Models
por: Li, Yiyuan, et al.
Publicado: (2024)

Evaluating Ill-Defined Tasks in Large Language Models
por: Zhou, Yi, et al.
Publicado: (2026)

The Point of No Return: Counterfactual Localization of Deceptive Commitment in Language-Model Reasoning
por: Merrill, Scott, et al.
Publicado: (2026)

Generative Evaluation of Complex Reasoning in Large Language Models
por: Lin, Haowei, et al.
Publicado: (2025)

Evaluating Large Language Models for Abstract Evaluation Tasks: An Empirical Study
por: Liu, Yinuo, et al.
Publicado: (2026)

MEDEQUALQA: Evaluating Biases in LLMs with Counterfactual Reasoning
por: Ghosh, Rajarshi, et al.
Publicado: (2025)

Counterfactual Probing for Hallucination Detection and Mitigation in Large Language Models
por: Feng, Yijun
Publicado: (2025)

Evaluating Consistency and Reasoning Capabilities of Large Language Models
por: Saxena, Yash, et al.
Publicado: (2024)

Deriving Strategic Market Insights with Large Language Models: A Benchmark for Forward Counterfactual Generation
por: Ong, Keane, et al.
Publicado: (2025)

Derivational Morphology Reveals Analogical Generalization in Large Language Models
por: Hofmann, Valentin, et al.
Publicado: (2024)

Evaluating Large Language Models for Real-World Engineering Tasks
por: Heesch, Rene, et al.
Publicado: (2025)

Evaluating Computational Accuracy of Large Language Models in Numerical Reasoning Tasks for Healthcare Applications
por: Malghan, Arjun R.
Publicado: (2025)

Reasoning Elicitation in Language Models via Counterfactual Feedback
por: Hüyük, Alihan, et al.
Publicado: (2024)

Zero-Shot Commonsense Validation and Reasoning with Large Language Models: An Evaluation on SemEval-2020 Task 4 Dataset
por: Alfugaha, Rawand, et al.
Publicado: (2025)

Can Large Language Models Create New Knowledge for Spatial Reasoning Tasks?
por: Greatrix, Thomas, et al.
Publicado: (2024)

Hypothesis-Driven Theory-of-Mind Reasoning for Large Language Models
por: Kim, Hyunwoo, et al.
Publicado: (2025)

Understanding Artificial Theory of Mind: Perturbed Tasks and Reasoning in Large Language Models
por: Nickel, Christian, et al.
Publicado: (2026)

Using Contrastive Learning to Improve Two-Way Reasoning in Large Language Models: The Obfuscation Task as a Case Study
por: Nikiema, Serge Lionel, et al.
Publicado: (2025)

Counterfactual-Consistency Prompting for Relative Temporal Understanding in Large Language Models
por: Kim, Jongho, et al.
Publicado: (2025)

A Comprehensive Evaluation on Event Reasoning of Large Language Models
por: Tao, Zhengwei, et al.
Publicado: (2024)

GLoRE: Evaluating Logical Reasoning of Large Language Models
por: liu, Hanmeng, et al.
Publicado: (2023)

Applications of Large Language Model Reasoning in Feature Generation
por: Chandra, Dharani
Publicado: (2025)