Emergent Languages in Populations of Language Model Agents: From Token Efficiency to Oversight Evasion

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Beltoft, Stine Lyngsø, Brach, William, Torrielli, Federico, Nielsen, Jacob, Pirchert, Annemette Brok, Tonini, Filippo, Schneider-Kamp, Peter, Poech, Lukas Galke
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866910272011108352
author Beltoft, Stine Lyngsø
Brach, William
Torrielli, Federico
Nielsen, Jacob
Pirchert, Annemette Brok
Tonini, Filippo
Schneider-Kamp, Peter
Poech, Lukas Galke
author_facet Beltoft, Stine Lyngsø
Brach, William
Torrielli, Federico
Nielsen, Jacob
Pirchert, Annemette Brok
Tonini, Filippo
Schneider-Kamp, Peter
Poech, Lukas Galke
contents Monitoring autonomous language model agents currently relies mostly on surface behavior. But what happens when agent populations invent new languages with the goal of avoiding human oversight. Here, we study the emergent languages on Moltbook. For this, we build upon the Moltbook Files dataset and apply a two-stage approach consisting of a rule-based heuristic (about 6000 matches) followed by zero-shot classification (518 kept). The resulting categories include token efficiency (166), new natural languages (106), and oversight evasion (59). We conduct both quantitative and qualitative analyses. Our results show that posts proposing new languages for avoiding oversight are judged by DeepSeek-3.2 as being less aligned than the other categories and that all languages can be learned by other language models in-context merely from a description of the language. Moreover, manually studying exemplary cases reveals surprisingly sophisticated steganographic protocols like embedding hidden messages in natural language. Although we cannot be certain about the extent of autonomy in ideation of these languages, our results add up to the evidence that monitoring surface behavior may soon be insufficient for retaining control over agent populations.
format Preprint
id arxiv_https___arxiv_org_abs_2605_31170
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Emergent Languages in Populations of Language Model Agents: From Token Efficiency to Oversight Evasion
Beltoft, Stine Lyngsø
Brach, William
Torrielli, Federico
Nielsen, Jacob
Pirchert, Annemette Brok
Tonini, Filippo
Schneider-Kamp, Peter
Poech, Lukas Galke
Computation and Language
Artificial Intelligence
Monitoring autonomous language model agents currently relies mostly on surface behavior. But what happens when agent populations invent new languages with the goal of avoiding human oversight. Here, we study the emergent languages on Moltbook. For this, we build upon the Moltbook Files dataset and apply a two-stage approach consisting of a rule-based heuristic (about 6000 matches) followed by zero-shot classification (518 kept). The resulting categories include token efficiency (166), new natural languages (106), and oversight evasion (59). We conduct both quantitative and qualitative analyses. Our results show that posts proposing new languages for avoiding oversight are judged by DeepSeek-3.2 as being less aligned than the other categories and that all languages can be learned by other language models in-context merely from a description of the language. Moreover, manually studying exemplary cases reveals surprisingly sophisticated steganographic protocols like embedding hidden messages in natural language. Although we cannot be certain about the extent of autonomy in ideation of these languages, our results add up to the evidence that monitoring surface behavior may soon be insufficient for retaining control over agent populations.
title Emergent Languages in Populations of Language Model Agents: From Token Efficiency to Oversight Evasion
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2605.31170