Proof of Thought : Neurosymbolic Program Synthesis allows Robust and Interpretable Reasoning

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Ganguly, Debargha, Iyengar, Srinivasan, Chaudhary, Vipin, Kalyanaraman, Shivkumar
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866914985215524864
author Ganguly, Debargha
Iyengar, Srinivasan
Chaudhary, Vipin
Kalyanaraman, Shivkumar
author_facet Ganguly, Debargha
Iyengar, Srinivasan
Chaudhary, Vipin
Kalyanaraman, Shivkumar
contents Large Language Models (LLMs) have revolutionized natural language processing, yet they struggle with inconsistent reasoning, particularly in novel domains and complex logical sequences. This research introduces Proof of Thought, a framework that enhances the reliability and transparency of LLM outputs. Our approach bridges LLM-generated ideas with formal logic verification, employing a custom interpreter to convert LLM outputs into First Order Logic constructs for theorem prover scrutiny. Central to our method is an intermediary JSON-based Domain-Specific Language, which by design balances precise logical structures with intuitive human concepts. This hybrid representation enables both rigorous validation and accessible human comprehension of LLM reasoning processes. Key contributions include a robust type system with sort management for enhanced logical integrity, explicit representation of rules for clear distinction between factual and inferential knowledge, and a flexible architecture that allows for easy extension to various domain-specific applications. We demonstrate Proof of Thought's effectiveness through benchmarking on StrategyQA and a novel multimodal reasoning task, showing improved performance in open-ended scenarios. By providing verifiable and interpretable results, our technique addresses critical needs for AI system accountability and sets a foundation for human-in-the-loop oversight in high-stakes domains.
format Preprint
id arxiv_https___arxiv_org_abs_2409_17270
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Proof of Thought : Neurosymbolic Program Synthesis allows Robust and Interpretable Reasoning
Ganguly, Debargha
Iyengar, Srinivasan
Chaudhary, Vipin
Kalyanaraman, Shivkumar
Artificial Intelligence
Computation and Language
Machine Learning
Logic in Computer Science
Neural and Evolutionary Computing
Large Language Models (LLMs) have revolutionized natural language processing, yet they struggle with inconsistent reasoning, particularly in novel domains and complex logical sequences. This research introduces Proof of Thought, a framework that enhances the reliability and transparency of LLM outputs. Our approach bridges LLM-generated ideas with formal logic verification, employing a custom interpreter to convert LLM outputs into First Order Logic constructs for theorem prover scrutiny. Central to our method is an intermediary JSON-based Domain-Specific Language, which by design balances precise logical structures with intuitive human concepts. This hybrid representation enables both rigorous validation and accessible human comprehension of LLM reasoning processes. Key contributions include a robust type system with sort management for enhanced logical integrity, explicit representation of rules for clear distinction between factual and inferential knowledge, and a flexible architecture that allows for easy extension to various domain-specific applications. We demonstrate Proof of Thought's effectiveness through benchmarking on StrategyQA and a novel multimodal reasoning task, showing improved performance in open-ended scenarios. By providing verifiable and interpretable results, our technique addresses critical needs for AI system accountability and sets a foundation for human-in-the-loop oversight in high-stakes domains.
title Proof of Thought : Neurosymbolic Program Synthesis allows Robust and Interpretable Reasoning
topic Artificial Intelligence
Computation and Language
Machine Learning
Logic in Computer Science
Neural and Evolutionary Computing
url https://arxiv.org/abs/2409.17270