Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Faronius, Håkan Karlsson, Martires, Pedro Zuidberg Dos
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:https://arxiv.org/abs/2504.07851
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866915245186875392
author Faronius, Håkan Karlsson
Martires, Pedro Zuidberg Dos
author_facet Faronius, Håkan Karlsson
Martires, Pedro Zuidberg Dos
contents A popular approach to neurosymbolic AI is to take the output of the last layer of a neural network, e.g. a softmax activation, and pass it through a sparse computation graph encoding certain logical constraints one wishes to enforce. This induces a probability distribution over a set of random variables, which happen to be conditionally independent of each other in many commonly used neurosymbolic AI models. Such conditionally independent random variables have been deemed harmful as their presence has been observed to co-occur with a phenomenon dubbed deterministic bias, where systems learn to deterministically prefer one of the valid solutions from the solution space over the others. We provide evidence contesting this conclusion and show that the phenomenon of deterministic bias is an artifact of improperly applying neurosymbolic AI.
format Preprint
id arxiv_https___arxiv_org_abs_2504_07851
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Independence Is Not an Issue in Neurosymbolic AI
Faronius, Håkan Karlsson
Martires, Pedro Zuidberg Dos
Artificial Intelligence
A popular approach to neurosymbolic AI is to take the output of the last layer of a neural network, e.g. a softmax activation, and pass it through a sparse computation graph encoding certain logical constraints one wishes to enforce. This induces a probability distribution over a set of random variables, which happen to be conditionally independent of each other in many commonly used neurosymbolic AI models. Such conditionally independent random variables have been deemed harmful as their presence has been observed to co-occur with a phenomenon dubbed deterministic bias, where systems learn to deterministically prefer one of the valid solutions from the solution space over the others. We provide evidence contesting this conclusion and show that the phenomenon of deterministic bias is an artifact of improperly applying neurosymbolic AI.
title Independence Is Not an Issue in Neurosymbolic AI
topic Artificial Intelligence
url https://arxiv.org/abs/2504.07851