The emergence of numerical representations in communicating artificial agents

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Mihai, Daniela, Weber, Lucas, Franzon, Francesca
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866910019343089664
author Mihai, Daniela
Weber, Lucas
Franzon, Francesca
author_facet Mihai, Daniela
Weber, Lucas
Franzon, Francesca
contents Human languages provide efficient systems for expressing numerosities, but whether the sheer pressure to communicate is enough for numerical representations to arise in artificial agents, and whether the emergent codes resemble human numerals at all, remains an open question. We study two neural network-based agents that must communicate numerosities in a referential game using either discrete tokens or continuous sketches, thus exploring both symbolic and iconic representations. Without any pre-defined numeric concepts, the agents achieve high in-distribution communication accuracy in both communication channels and converge on high-precision symbol-meaning mappings. However, the emergent code is non-compositional: the agents fail to derive systematic messages for unseen numerosities, typically reusing the symbol of the highest trained numerosity (discrete), or collapsing extrapolated values onto a single sketch (continuous). We conclude that the communication pressure alone suffices for precise transmission of learned numerosities, but additional pressures are needed to yield compositional codes and generalisation abilities.
format Preprint
id arxiv_https___arxiv_org_abs_2602_10996
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle The emergence of numerical representations in communicating artificial agents
Mihai, Daniela
Weber, Lucas
Franzon, Francesca
Multiagent Systems
Computation and Language
Machine Learning
Human languages provide efficient systems for expressing numerosities, but whether the sheer pressure to communicate is enough for numerical representations to arise in artificial agents, and whether the emergent codes resemble human numerals at all, remains an open question. We study two neural network-based agents that must communicate numerosities in a referential game using either discrete tokens or continuous sketches, thus exploring both symbolic and iconic representations. Without any pre-defined numeric concepts, the agents achieve high in-distribution communication accuracy in both communication channels and converge on high-precision symbol-meaning mappings. However, the emergent code is non-compositional: the agents fail to derive systematic messages for unseen numerosities, typically reusing the symbol of the highest trained numerosity (discrete), or collapsing extrapolated values onto a single sketch (continuous). We conclude that the communication pressure alone suffices for precise transmission of learned numerosities, but additional pressures are needed to yield compositional codes and generalisation abilities.
title The emergence of numerical representations in communicating artificial agents
topic Multiagent Systems
Computation and Language
Machine Learning
url https://arxiv.org/abs/2602.10996