Infusing Theory of Mind into Socially Intelligent LLM Agents

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Hwang, EunJeong, Yin, Yuwei, Carenini, Giuseppe, West, Peter, Shwartz, Vered
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866913023316197376
author Hwang, EunJeong
Yin, Yuwei
Carenini, Giuseppe
West, Peter
Shwartz, Vered
author_facet Hwang, EunJeong
Yin, Yuwei
Carenini, Giuseppe
West, Peter
Shwartz, Vered
contents Theory of Mind (ToM)-an understanding of the mental states of others-is a key aspect of human social intelligence, yet, chatbots and LLM-based social agents do not typically integrate it. In this work, we demonstrate that LLMs that explicitly use ToM get better at dialogue, achieving goals more effectively. After showing that simply prompting models to generate mental states between dialogue turns already provides significant benefit, we further introduce ToMAgent (ToMA), a ToM-focused dialogue agent. ToMA is trained by pairing ToM with dialogue lookahead to produce mental states that are maximally useful for achieving dialogue goals. Experiments on the Sotopia interactive social evaluation benchmark demonstrate the effectiveness of our method over a range of baselines. Comprehensive analysis shows that ToMA exhibits more strategic, goal-oriented reasoning behaviors, which enable long-horizon adaptation, while maintaining better relationships with their partners. Our results suggest a step forward in integrating ToM for building socially intelligent LLM agents.
format Preprint
id arxiv_https___arxiv_org_abs_2509_22887
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Infusing Theory of Mind into Socially Intelligent LLM Agents
Hwang, EunJeong
Yin, Yuwei
Carenini, Giuseppe
West, Peter
Shwartz, Vered
Computation and Language
Theory of Mind (ToM)-an understanding of the mental states of others-is a key aspect of human social intelligence, yet, chatbots and LLM-based social agents do not typically integrate it. In this work, we demonstrate that LLMs that explicitly use ToM get better at dialogue, achieving goals more effectively. After showing that simply prompting models to generate mental states between dialogue turns already provides significant benefit, we further introduce ToMAgent (ToMA), a ToM-focused dialogue agent. ToMA is trained by pairing ToM with dialogue lookahead to produce mental states that are maximally useful for achieving dialogue goals. Experiments on the Sotopia interactive social evaluation benchmark demonstrate the effectiveness of our method over a range of baselines. Comprehensive analysis shows that ToMA exhibits more strategic, goal-oriented reasoning behaviors, which enable long-horizon adaptation, while maintaining better relationships with their partners. Our results suggest a step forward in integrating ToM for building socially intelligent LLM agents.
title Infusing Theory of Mind into Socially Intelligent LLM Agents
topic Computation and Language
url https://arxiv.org/abs/2509.22887