Current Practices for Building LLM-Powered Reasoning Tools Are Ad Hoc -- and We Can Do Better

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteur principal: Bembenek, Aaron
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866908440902762496
author Bembenek, Aaron
author_facet Bembenek, Aaron
contents There is growing excitement about building software verifiers, synthesizers, and other Automated Reasoning (AR) tools by combining traditional symbolic algorithms and Large Language Models (LLMs). Unfortunately, the current practice for constructing such neurosymbolic AR systems is an ad hoc programming model that does not have the strong guarantees of traditional symbolic algorithms, nor a deep enough synchronization of neural networks and symbolic reasoning to unlock the full potential of LLM-powered reasoning. I propose Neurosymbolic Transition Systems as a principled computational model that can underlie infrastructure for building neurosymbolic AR tools. In this model, symbolic state is paired with intuition, and state transitions operate over symbols and intuition in parallel. I argue why this new paradigm can scale logical reasoning beyond current capabilities while retaining the strong guarantees of symbolic algorithms, and I sketch out how the computational model I propose can be reified in a logic programming language.
format Preprint
id arxiv_https___arxiv_org_abs_2507_05886
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Current Practices for Building LLM-Powered Reasoning Tools Are Ad Hoc -- and We Can Do Better
Bembenek, Aaron
Artificial Intelligence
Programming Languages
There is growing excitement about building software verifiers, synthesizers, and other Automated Reasoning (AR) tools by combining traditional symbolic algorithms and Large Language Models (LLMs). Unfortunately, the current practice for constructing such neurosymbolic AR systems is an ad hoc programming model that does not have the strong guarantees of traditional symbolic algorithms, nor a deep enough synchronization of neural networks and symbolic reasoning to unlock the full potential of LLM-powered reasoning. I propose Neurosymbolic Transition Systems as a principled computational model that can underlie infrastructure for building neurosymbolic AR tools. In this model, symbolic state is paired with intuition, and state transitions operate over symbols and intuition in parallel. I argue why this new paradigm can scale logical reasoning beyond current capabilities while retaining the strong guarantees of symbolic algorithms, and I sketch out how the computational model I propose can be reified in a logic programming language.
title Current Practices for Building LLM-Powered Reasoning Tools Are Ad Hoc -- and We Can Do Better
topic Artificial Intelligence
Programming Languages
url https://arxiv.org/abs/2507.05886