A Message Passing Realization of Expected Free Energy Minimization

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Nuijten, Wouter W. L., Lukashchuk, Mykola, van de Laar, Thijs, de Vries, Bert
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866908859531001856
author Nuijten, Wouter W. L.
Lukashchuk, Mykola
van de Laar, Thijs
de Vries, Bert
author_facet Nuijten, Wouter W. L.
Lukashchuk, Mykola
van de Laar, Thijs
de Vries, Bert
contents We present a message passing approach to Expected Free Energy (EFE) minimization on factor graphs, based on the theory introduced in arXiv:2504.14898. By reformulating EFE minimization as Variational Free Energy minimization with epistemic priors, we transform a combinatorial search problem into a tractable inference problem solvable through standard variational techniques. Applying our message passing method to factorized state-space models enables efficient policy inference. We evaluate our method on environments with epistemic uncertainty: a stochastic gridworld and a partially observable Minigrid task. Agents using our approach consistently outperform conventional KL-control agents on these tasks, showing more robust planning and efficient exploration under uncertainty. In the stochastic gridworld environment, EFE-minimizing agents avoid risky paths, while in the partially observable minigrid setting, they conduct more systematic information-seeking. This approach bridges active inference theory with practical implementations, providing empirical evidence for the efficiency of epistemic priors in artificial agents.
format Preprint
id arxiv_https___arxiv_org_abs_2508_02197
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Message Passing Realization of Expected Free Energy Minimization
Nuijten, Wouter W. L.
Lukashchuk, Mykola
van de Laar, Thijs
de Vries, Bert
Artificial Intelligence
We present a message passing approach to Expected Free Energy (EFE) minimization on factor graphs, based on the theory introduced in arXiv:2504.14898. By reformulating EFE minimization as Variational Free Energy minimization with epistemic priors, we transform a combinatorial search problem into a tractable inference problem solvable through standard variational techniques. Applying our message passing method to factorized state-space models enables efficient policy inference. We evaluate our method on environments with epistemic uncertainty: a stochastic gridworld and a partially observable Minigrid task. Agents using our approach consistently outperform conventional KL-control agents on these tasks, showing more robust planning and efficient exploration under uncertainty. In the stochastic gridworld environment, EFE-minimizing agents avoid risky paths, while in the partially observable minigrid setting, they conduct more systematic information-seeking. This approach bridges active inference theory with practical implementations, providing empirical evidence for the efficiency of epistemic priors in artificial agents.
title A Message Passing Realization of Expected Free Energy Minimization
topic Artificial Intelligence
url https://arxiv.org/abs/2508.02197