Learning Approximate and Exact Numeral Systems via Reinforcement Learning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Carlsson, Emil, Dubhashi, Devdatt, Johansson, Fredrik D.
Format: Preprint
Published: 2021
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914775272783872
author Carlsson, Emil
Dubhashi, Devdatt
Johansson, Fredrik D.
author_facet Carlsson, Emil
Dubhashi, Devdatt
Johansson, Fredrik D.
contents Recent work (Xu et al., 2020) has suggested that numeral systems in different languages are shaped by a functional need for efficient communication in an information-theoretic sense. Here we take a learning-theoretic approach and show how efficient communication emerges via reinforcement learning. In our framework, two artificial agents play a Lewis signaling game where the goal is to convey a numeral concept. The agents gradually learn to communicate using reinforcement learning and the resulting numeral systems are shown to be efficient in the information-theoretic framework of Regier et al. (2015); Gibson et al. (2017). They are also shown to be similar to human numeral systems of same type. Our results thus provide a mechanistic explanation via reinforcement learning of the recent results in Xu et al. (2020) and can potentially be generalized to other semantic domains.
format Preprint
id arxiv_https___arxiv_org_abs_2105_13857
institution arXiv
publishDate 2021
record_format arxiv
spellingShingle Learning Approximate and Exact Numeral Systems via Reinforcement Learning
Carlsson, Emil
Dubhashi, Devdatt
Johansson, Fredrik D.
Computation and Language
Artificial Intelligence
Recent work (Xu et al., 2020) has suggested that numeral systems in different languages are shaped by a functional need for efficient communication in an information-theoretic sense. Here we take a learning-theoretic approach and show how efficient communication emerges via reinforcement learning. In our framework, two artificial agents play a Lewis signaling game where the goal is to convey a numeral concept. The agents gradually learn to communicate using reinforcement learning and the resulting numeral systems are shown to be efficient in the information-theoretic framework of Regier et al. (2015); Gibson et al. (2017). They are also shown to be similar to human numeral systems of same type. Our results thus provide a mechanistic explanation via reinforcement learning of the recent results in Xu et al. (2020) and can potentially be generalized to other semantic domains.
title Learning Approximate and Exact Numeral Systems via Reinforcement Learning
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2105.13857