On Predictive planning and counterfactual learning in active inference

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Paul, Aswin, Isomura, Takuya, Razi, Adeel
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929380719067136
author Paul, Aswin
Isomura, Takuya
Razi, Adeel
author_facet Paul, Aswin
Isomura, Takuya
Razi, Adeel
contents Given the rapid advancement of artificial intelligence, understanding the foundations of intelligent behaviour is increasingly important. Active inference, regarded as a general theory of behaviour, offers a principled approach to probing the basis of sophistication in planning and decision-making. In this paper, we examine two decision-making schemes in active inference based on 'planning' and 'learning from experience'. Furthermore, we also introduce a mixed model that navigates the data-complexity trade-off between these strategies, leveraging the strengths of both to facilitate balanced decision-making. We evaluate our proposed model in a challenging grid-world scenario that requires adaptability from the agent. Additionally, our model provides the opportunity to analyze the evolution of various parameters, offering valuable insights and contributing to an explainable framework for intelligent decision-making.
format Preprint
id arxiv_https___arxiv_org_abs_2403_12417
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle On Predictive planning and counterfactual learning in active inference
Paul, Aswin
Isomura, Takuya
Razi, Adeel
Artificial Intelligence
Machine Learning
Methodology
Given the rapid advancement of artificial intelligence, understanding the foundations of intelligent behaviour is increasingly important. Active inference, regarded as a general theory of behaviour, offers a principled approach to probing the basis of sophistication in planning and decision-making. In this paper, we examine two decision-making schemes in active inference based on 'planning' and 'learning from experience'. Furthermore, we also introduce a mixed model that navigates the data-complexity trade-off between these strategies, leveraging the strengths of both to facilitate balanced decision-making. We evaluate our proposed model in a challenging grid-world scenario that requires adaptability from the agent. Additionally, our model provides the opportunity to analyze the evolution of various parameters, offering valuable insights and contributing to an explainable framework for intelligent decision-making.
title On Predictive planning and counterfactual learning in active inference
topic Artificial Intelligence
Machine Learning
Methodology
url https://arxiv.org/abs/2403.12417