Curiosity-Driven Development of Action and Language in Robots Through Self-Exploration

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Tinker, Theodore Jerome, Doya, Kenji, Tani, Jun
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866911321496223744
author Tinker, Theodore Jerome
Doya, Kenji
Tani, Jun
author_facet Tinker, Theodore Jerome
Doya, Kenji
Tani, Jun
contents Infants acquire language with generalization from minimal experience, whereas large language models require billions of training tokens. What underlies efficient development in humans? We investigated this problem through experiments wherein robotic agents learn to perform actions associated with imperative sentences (e.g., push red cube) via curiosity-driven self-exploration. Our approach integrates active inference with reinforcement learning, enabling intrinsically motivated developmental learning. The simulations reveal key findings corresponding to observations in developmental psychology. i) Generalization improves drastically as the scale of compositional elements increases. ii) Curiosity improves learning through self-exploration. iii) Rote pairing of sentences and actions precedes compositional generalization. iv) Simpler actions develop before complex actions depending on them. v) Exception-handling induces U-shaped developmental performance, a pattern like representational redescription in child language learning. These results suggest that curiosity-driven active inference accounts for how intrinsically motivated sensorimotor-linguistic learning supports scalable compositional generalization and exception handling in humans and artificial agents.
format Preprint
id arxiv_https___arxiv_org_abs_2510_05013
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Curiosity-Driven Development of Action and Language in Robots Through Self-Exploration
Tinker, Theodore Jerome
Doya, Kenji
Tani, Jun
Machine Learning
Infants acquire language with generalization from minimal experience, whereas large language models require billions of training tokens. What underlies efficient development in humans? We investigated this problem through experiments wherein robotic agents learn to perform actions associated with imperative sentences (e.g., push red cube) via curiosity-driven self-exploration. Our approach integrates active inference with reinforcement learning, enabling intrinsically motivated developmental learning. The simulations reveal key findings corresponding to observations in developmental psychology. i) Generalization improves drastically as the scale of compositional elements increases. ii) Curiosity improves learning through self-exploration. iii) Rote pairing of sentences and actions precedes compositional generalization. iv) Simpler actions develop before complex actions depending on them. v) Exception-handling induces U-shaped developmental performance, a pattern like representational redescription in child language learning. These results suggest that curiosity-driven active inference accounts for how intrinsically motivated sensorimotor-linguistic learning supports scalable compositional generalization and exception handling in humans and artificial agents.
title Curiosity-Driven Development of Action and Language in Robots Through Self-Exploration
topic Machine Learning
url https://arxiv.org/abs/2510.05013