SoMi-ToM: Evaluating Multi-Perspective Theory of Mind in Embodied Social Interactions

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Fan, Xianzhe, Zhou, Xuhui, Jin, Chuanyang, Nottingham, Kolby, Zhu, Hao, Sap, Maarten
Format:	Preprint
Published:	2025
Subjects:	Computation and Language Artificial Intelligence Computer Vision and Pattern Recognition Robotics
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

MuMA-ToM: Multi-modal Multi-Agent Theory of Mind
by: Shi, Haojun, et al.
Published: (2024)

ToM-SSI: Evaluating Theory of Mind in Situated Social Interactions
by: Bortoletto, Matteo, et al.
Published: (2025)

Rethinking Theory of Mind Benchmarks for LLMs: Towards A User-Centered Perspective
by: Wang, Qiaosi, et al.
Published: (2025)

MiMo-Embodied: X-Embodied Foundation Model Technical Report
by: Hao, Xiaoshuai, et al.
Published: (2025)

Multi-ToM: Evaluating Multilingual Theory of Mind Capabilities in Large Language Models
by: Sadhu, Jayanta, et al.
Published: (2024)

Minion: A Technology Probe to Explore How Users Negotiate Harmful Value Conflicts with AI Companions
by: Fan, Xianzhe, et al.
Published: (2024)

Collaborating Action by Action: A Multi-agent LLM Framework for Embodied Reasoning
by: White, Isadora, et al.
Published: (2025)

User-Driven Value Alignment: Understanding Users' Perceptions and Strategies for Addressing Biased and Discriminatory Statements in AI Companions
by: Fan, Xianzhe, et al.
Published: (2024)

Is this the real life? Is this just fantasy? The Misleading Success of Simulating Social Interactions With LLMs
by: Zhou, Xuhui, et al.
Published: (2024)

Pragmatic Embodied Spoken Instruction Following in Human-Robot Collaboration with Theory of Mind
by: Ying, Lance, et al.
Published: (2024)

ENACT: Evaluating Embodied Cognition with World Modeling of Egocentric Interaction
by: Wang, Qineng, et al.
Published: (2025)

MaMi-HOI: Harmonizing Global Kinematics and Local Geometry for Human-Object Interaction Generation
by: Wang, Hao, et al.
Published: (2026)

SOTOPIA-TOM: Evaluating Information Management in Multi-Agent Interaction with Theory of Mind
by: YS, Yashwanth, et al.
Published: (2026)

Video-Only ToM: Enhancing Theory of Mind in Multimodal Large Language Models
by: Liu, Siqi, et al.
Published: (2026)

Mind the Gesture: Evaluating AI Sensitivity to Culturally Offensive Non-Verbal Gestures
by: Yerukola, Akhila, et al.
Published: (2025)

Theory of Mind abilities of Large Language Models in Human-Robot Interaction : An Illusion?
by: Verma, Mudit, et al.
Published: (2024)

EmbodiedBrain: Expanding Performance Boundaries of Task Planning for Embodied Intelligence
by: Zou, Ding, et al.
Published: (2025)

Mind Modeling: A ToM-Based Framework for Personalization
by: Gena, Cristina
Published: (2026)

UGotMe: An Embodied System for Affective Human-Robot Interaction
by: Li, Peizhen, et al.
Published: (2024)

Closed Loop Interactive Embodied Reasoning for Robot Manipulation
by: Nazarczuk, Michal, et al.
Published: (2024)

Somatic Safety: An Embodied Approach Towards Safe Human-Robot Interaction
by: Benford, Steve, et al.
Published: (2025)

Second-order Theory of Mind for Human Teachers and Robot Learners
by: Callaghan, Patrick, et al.
Published: (2025)

ReWorld: Multi-Dimensional Reward Modeling for Embodied World Models
by: Peng, Baorui, et al.
Published: (2026)

VITA-E: Natural Embodied Interaction with Concurrent Seeing, Hearing, Speaking, and Acting
by: Liu, Xiaoyu, et al.
Published: (2025)

Rank-O-ToM: Unlocking Emotional Nuance Ranking to Enhance Affective Theory-of-Mind
by: Kim, JiHyun, et al.
Published: (2025)

Introduction to Human-Robot Interaction: A Multi-Perspective Introductory Course
by: Williams, Tom
Published: (2024)

SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agents
by: Zhou, Xuhui, et al.
Published: (2023)

Visual Environment-Interactive Planning for Embodied Complex-Question Answering
by: Lan, Ning, et al.
Published: (2025)

IS-Bench: Evaluating Interactive Safety of VLM-Driven Embodied Agents in Daily Household Tasks
by: Lu, Xiaoya, et al.
Published: (2025)

DEL-ToM: Inference-Time Scaling for Theory-of-Mind Reasoning via Dynamic Epistemic Logic
by: Wu, Yuheng, et al.
Published: (2025)

ToM-LM: Delegating Theory of Mind Reasoning to External Symbolic Executors in Large Language Models
by: Tang, Weizhi, et al.
Published: (2024)

Multimodal Data Storage and Retrieval for Embodied AI: A Survey
by: Lu, Yihao, et al.
Published: (2025)

AToM-Bot: Embodied Fulfillment of Unspoken Human Needs with Affective Theory of Mind
by: Ding, Wei, et al.
Published: (2024)

WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Models
by: Shang, Yu, et al.
Published: (2026)

Agent-ToM: Learning to Monitor Autonomous LLM Agents via Theory-of-Mind Reasoning
by: Ahmed, Nesreen K., et al.
Published: (2026)

WoW: Towards a World omniscient World model Through Embodied Interaction
by: Chi, Xiaowei, et al.
Published: (2025)

FindingDory: A Benchmark to Evaluate Memory in Embodied Agents
by: Yadav, Karmesh, et al.
Published: (2025)

Guide, Think, Act: Interactive Embodied Reasoning in Vision-Language-Action Models
by: Ling, Yiran, et al.
Published: (2026)

Mind Meets Robots: A Review of EEG-Based Brain-Robot Interaction Systems
by: Zhang, Yuchong, et al.
Published: (2024)

Nav-R1: Reasoning and Navigation in Embodied Scenes
by: Liu, Qingxiang, et al.
Published: (2025)