Social-R1: Towards Human-like Social Reasoning in LLMs

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Wu, Jincenzi, Lei, Yuxuan, Lian, Jianxun, Huang, Yitian, Zhou, Lexin, Li, Haotian, Xie, Xing, Meng, Helen
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866914380947390464
author Wu, Jincenzi
Lei, Yuxuan
Lian, Jianxun
Huang, Yitian
Zhou, Lexin
Li, Haotian
Xie, Xing
Meng, Helen
author_facet Wu, Jincenzi
Lei, Yuxuan
Lian, Jianxun
Huang, Yitian
Zhou, Lexin
Li, Haotian
Xie, Xing
Meng, Helen
contents While large language models demonstrate remarkable capabilities across numerous domains, social intelligence - the capacity to perceive social cues, infer mental states, and generate appropriate responses - remains a critical challenge, particularly for enabling effective human-AI collaboration and developing AI that truly serves human needs. Current models often rely on superficial patterns rather than genuine social reasoning. We argue that cultivating human-like social intelligence requires training with challenging cases that resist shortcut solutions. To this end, we introduce ToMBench-Hard, an adversarial benchmark designed to provide hard training examples for social reasoning. Building on this, we propose Social-R1, a reinforcement learning framework that aligns model reasoning with human cognition through multi-dimensional rewards. Unlike outcome-based RL, Social-R1 supervises the entire reasoning process, enforcing structural alignment, logical integrity, and information density. Results show that our approach enables a 4B parameter model to surpass much larger counterparts and generalize robustly across eight diverse benchmarks. These findings demonstrate that challenging training cases with trajectory-level alignment offer a path toward efficient and reliable social intelligence.
format Preprint
id arxiv_https___arxiv_org_abs_2603_09249
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Social-R1: Towards Human-like Social Reasoning in LLMs
Wu, Jincenzi
Lei, Yuxuan
Lian, Jianxun
Huang, Yitian
Zhou, Lexin
Li, Haotian
Xie, Xing
Meng, Helen
Artificial Intelligence
While large language models demonstrate remarkable capabilities across numerous domains, social intelligence - the capacity to perceive social cues, infer mental states, and generate appropriate responses - remains a critical challenge, particularly for enabling effective human-AI collaboration and developing AI that truly serves human needs. Current models often rely on superficial patterns rather than genuine social reasoning. We argue that cultivating human-like social intelligence requires training with challenging cases that resist shortcut solutions. To this end, we introduce ToMBench-Hard, an adversarial benchmark designed to provide hard training examples for social reasoning. Building on this, we propose Social-R1, a reinforcement learning framework that aligns model reasoning with human cognition through multi-dimensional rewards. Unlike outcome-based RL, Social-R1 supervises the entire reasoning process, enforcing structural alignment, logical integrity, and information density. Results show that our approach enables a 4B parameter model to surpass much larger counterparts and generalize robustly across eight diverse benchmarks. These findings demonstrate that challenging training cases with trajectory-level alignment offer a path toward efficient and reliable social intelligence.
title Social-R1: Towards Human-like Social Reasoning in LLMs
topic Artificial Intelligence
url https://arxiv.org/abs/2603.09249