How Intrinsic Motivation Underlies Embodied Open-Ended Behavior

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Moreno-Bote, Rubén, Haefner, Ralf, Galiano-Landeira, Jordi, Yang, Tianming, Maldonado, Pedro
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866918291065274368
author Moreno-Bote, Rubén
Haefner, Ralf
Galiano-Landeira, Jordi
Yang, Tianming
Maldonado, Pedro
author_facet Moreno-Bote, Rubén
Haefner, Ralf
Galiano-Landeira, Jordi
Yang, Tianming
Maldonado, Pedro
contents Although most theories posit that natural behavior can be explained as maximizing some form of extrinsic reward, often called utility, some behaviors appear to be reward independent. For instance, spontaneous motor babbling in human newborns and curiosity in little kids and other animals seem to elude a simple explanation in terms of extrinsic reward maximization. Rooted in these observations, intrinsic motivation has emerged as a potentially major driver of behavior. However, only recently have several quantitative and foundational theories of intrinsic motivation been put forward. We first provide a general framework to understand behavior as being organized hierarchically: objective--intrinsic reward, or motivation--drives, goals and extrinsic reward. We next review the main formalizations of intrinsic motivation, including empowerment, the free energy principle, information-gain maximization, and the maximum occupancy principle. These theories produce complex behavior by promoting, in various ways, entropic action-state paths. The presence of a single intrinsic motivation objective breaks infinite regress, as drives and goals act only temporarily to serve the objective. Extrinsic rewards, such as sugar or protein, are just a means to achieve the objective. Bounded cognition and embodiment impose constraints and boundary conditions for the intrinsic motivation objective. By virtue of their capability to generate complex behavior in a task-agnostic manner, theories of intrinsic motivation promise to become successful generative models of open-ended, embodied behavior.
format Preprint
id arxiv_https___arxiv_org_abs_2601_10276
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle How Intrinsic Motivation Underlies Embodied Open-Ended Behavior
Moreno-Bote, Rubén
Haefner, Ralf
Galiano-Landeira, Jordi
Yang, Tianming
Maldonado, Pedro
Neurons and Cognition
Although most theories posit that natural behavior can be explained as maximizing some form of extrinsic reward, often called utility, some behaviors appear to be reward independent. For instance, spontaneous motor babbling in human newborns and curiosity in little kids and other animals seem to elude a simple explanation in terms of extrinsic reward maximization. Rooted in these observations, intrinsic motivation has emerged as a potentially major driver of behavior. However, only recently have several quantitative and foundational theories of intrinsic motivation been put forward. We first provide a general framework to understand behavior as being organized hierarchically: objective--intrinsic reward, or motivation--drives, goals and extrinsic reward. We next review the main formalizations of intrinsic motivation, including empowerment, the free energy principle, information-gain maximization, and the maximum occupancy principle. These theories produce complex behavior by promoting, in various ways, entropic action-state paths. The presence of a single intrinsic motivation objective breaks infinite regress, as drives and goals act only temporarily to serve the objective. Extrinsic rewards, such as sugar or protein, are just a means to achieve the objective. Bounded cognition and embodiment impose constraints and boundary conditions for the intrinsic motivation objective. By virtue of their capability to generate complex behavior in a task-agnostic manner, theories of intrinsic motivation promise to become successful generative models of open-ended, embodied behavior.
title How Intrinsic Motivation Underlies Embodied Open-Ended Behavior
topic Neurons and Cognition
url https://arxiv.org/abs/2601.10276