Social Cooperation in Conversational AI Agents

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Çelikok, Mustafa Mert, Bandyopadhyay, Saptarashmi, Loftin, Robert
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866908389624250368
author Çelikok, Mustafa Mert
Bandyopadhyay, Saptarashmi
Loftin, Robert
author_facet Çelikok, Mustafa Mert
Bandyopadhyay, Saptarashmi
Loftin, Robert
contents The development of AI agents based on large, open-domain language models (LLMs) has paved the way for the development of general-purpose AI assistants that can support human in tasks such as writing, coding, graphic design, and scientific research. A major challenge with such agents is that, by necessity, they are trained by observing relatively short-term interactions with humans. Such models can fail to generalize to long-term interactions, for example, interactions where a user has repeatedly corrected mistakes on the part of the agent. In this work, we argue that these challenges can be overcome by explicitly modeling humans' social intelligence, that is, their ability to build and maintain long-term relationships with other agents whose behavior cannot always be predicted. By mathematically modeling the strategies humans use to communicate and reason about one another over long periods of time, we may be able to derive new game theoretic objectives against which LLMs and future AI agents may be optimized.
format Preprint
id arxiv_https___arxiv_org_abs_2506_01624
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Social Cooperation in Conversational AI Agents
Çelikok, Mustafa Mert
Bandyopadhyay, Saptarashmi
Loftin, Robert
Artificial Intelligence
Machine Learning
I.2.6; I.2.7
The development of AI agents based on large, open-domain language models (LLMs) has paved the way for the development of general-purpose AI assistants that can support human in tasks such as writing, coding, graphic design, and scientific research. A major challenge with such agents is that, by necessity, they are trained by observing relatively short-term interactions with humans. Such models can fail to generalize to long-term interactions, for example, interactions where a user has repeatedly corrected mistakes on the part of the agent. In this work, we argue that these challenges can be overcome by explicitly modeling humans' social intelligence, that is, their ability to build and maintain long-term relationships with other agents whose behavior cannot always be predicted. By mathematically modeling the strategies humans use to communicate and reason about one another over long periods of time, we may be able to derive new game theoretic objectives against which LLMs and future AI agents may be optimized.
title Social Cooperation in Conversational AI Agents
topic Artificial Intelligence
Machine Learning
I.2.6; I.2.7
url https://arxiv.org/abs/2506.01624