Cover Image

On the Self-Verification Limitations of Large Language Models on Reasoning and Planning Tasks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Stechly, Kaya, Valmeekam, Karthik, Kambhampati, Subbarao
Format:	Preprint
Published:	2024
Subjects:	Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Chain of Thoughtlessness? An Analysis of CoT in Planning
by: Stechly, Kaya, et al.
Published: (2024)

LLMs Still Can't Plan; Can LRMs? A Preliminary Evaluation of OpenAI's o1 on PlanBench
by: Valmeekam, Karthik, et al.
Published: (2024)

Planning in Strawberry Fields: Evaluating and Improving the Planning and Scheduling Capabilities of LRM o1
by: Valmeekam, Karthik, et al.
Published: (2024)

Performative Thinking? The Brittle Correlation Between CoT Length and Problem Complexity
by: Palod, Vardhan, et al.
Published: (2025)

Beyond Semantics: The Unreasonable Effectiveness of Reasonless Intermediate Tokens
by: Valmeekam, Karthik, et al.
Published: (2025)

(How) Do reasoning models reason?
by: Subbarao Kambhampati, et al.
Published: (2025)

RL in Name Only? Analyzing the Structural Assumptions in RL post-training for LLMs
by: Samineni, Soumya Rani, et al.
Published: (2025)

LLMs Can't Plan, But Can Help Planning in LLM-Modulo Frameworks
by: Kambhampati, Subbarao, et al.
Published: (2024)

Can Large Language Models Reason and Plan?
by: Kambhampati, Subbarao
Published: (2024)

Robust Planning with Compound LLM Architectures: An LLM-Modulo Approach
by: Gundawar, Atharva, et al.
Published: (2024)

Position: Stop Anthropomorphizing Intermediate Tokens as Reasoning/Thinking Traces!
by: Kambhampati, Subbarao, et al.
Published: (2025)

Robust Planning with LLM-Modulo Framework: Case Study in Travel Planning
by: Gundawar, Atharva, et al.
Published: (2024)

Mind The Gap: Quantifying Mechanistic Gaps in Algorithmic Reasoning via Neural Compilation
by: Saldyt, Lucas, et al.
Published: (2025)

Algorithmic Language Models with Neurally Compiled Libraries
by: Saldyt, Lucas, et al.
Published: (2024)

On the Brittle Foundations of ReAct Prompting for Agentic Large Language Models
by: Verma, Mudit, et al.
Published: (2024)

Explainable Human-AI Interaction: A Planning Perspective
by: Sreedharan, Sarath, et al.
Published: (2024)

Theory of Mind abilities of Large Language Models in Human-Robot Interaction : An Illusion?
by: Verma, Mudit, et al.
Published: (2024)

Do Cognitively Interpretable Reasoning Traces Improve LLM Performance?
by: Bhambri, Siddhant, et al.
Published: (2025)

Task Success is not Enough: Investigating the Use of Video-Language Models as Behavior Critics for Catching Undesirable Agent Behaviors
by: Guan, Lin, et al.
Published: (2024)

Extracting Heuristics from Large Language Models for Reward Shaping in Reinforcement Learning
by: Bhambri, Siddhant, et al.
Published: (2024)

Interpretable Traces, Unexpected Outcomes: Investigating the Disconnect in Trace-Based Knowledge Distillation
by: Bhambri, Siddhant, et al.
Published: (2025)

interwhen: A Generalizable Framework for Steering Reasoning Models with Test-time Verification
by: Bhat, Vishak K, et al.
Published: (2026)

Who is Helping Whom? Analyzing Inter-dependencies to Evaluate Cooperation in Human-AI Teaming
by: Biswas, Upasana, et al.
Published: (2025)

The Geometry of Self-Verification in a Task-Specific Reasoning Model
by: Lee, Andrew, et al.
Published: (2025)

Self-Corrective Task Planning by Inverse Prompting with Large Language Models
by: Lee, Jiho, et al.
Published: (2025)

Local Coherence or Global Validity? Investigating RLVR Traces in Math Domains
by: Samineni, Soumya Rani, et al.
Published: (2025)

Incorporating Human Flexibility through Reward Preferences in Human-AI Teaming
by: Bhambri, Siddhant, et al.
Published: (2023)

On the Limits of Innate Planning in Large Language Models
by: Schepanowski, Charles, et al.
Published: (2025)

A Closer Look at the Self-Verification Abilities of Large Language Models in Logical Reasoning
by: Hong, Ruixin, et al.
Published: (2023)

LLM3:Large Language Model-based Task and Motion Planning with Motion Failure Reasoning
by: Wang, Shu, et al.
Published: (2024)

Reasoning on the Manifold: Bidirectional Consistency for Self-Verification in Diffusion Language Models
by: Ruan, Jiaoyang, et al.
Published: (2026)

Can large language models reason and plan?
by: Subbarao Kambhampati
Published: (2024)

PlanU: Large Language Model Reasoning through Planning under Uncertainty
by: Deng, Ziwei, et al.
Published: (2025)

On Reasoning Strength Planning in Large Reasoning Models
by: Sheng, Leheng, et al.
Published: (2025)

GraphReason: Enhancing Reasoning Capabilities of Large Language Models through A Graph-Based Verification Approach
by: Cao, Lang
Published: (2023)

Forward-Backward Reasoning in Large Language Models for Mathematical Verification
by: Jiang, Weisen, et al.
Published: (2023)

Reasoning Capabilities of Large Language Models on Dynamic Tasks
by: Wong, Annie, et al.
Published: (2025)

Plan Verification for LLM-Based Embodied Task Completion Agents
by: Hariharan, Ananth, et al.
Published: (2025)

Reasoning or Reciting? Exploring the Capabilities and Limitations of Language Models Through Counterfactual Tasks
by: Wu, Zhaofeng, et al.
Published: (2023)

A Human-Like Reasoning Framework for Multi-Phases Planning Task with Large Language Models
by: Xie, Chengxing, et al.
Published: (2024)