Evaluating and Modeling Social Intelligence: A Comparative Study of Human and AI Capabilities

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wang, Junqi, Zhang, Chunhui, Li, Jiapeng, Ma, Yuxi, Niu, Lixing, Han, Jiaheng, Peng, Yujia, Zhu, Yixin, Fan, Lifeng
Format:	Preprint
Published:	2024
Subjects:	Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

R^3-VQA: "Read the Room" by Video Social Reasoning
by: Niu, Lixing, et al.
Published: (2025)

Grounding Before Generalizing: How AI Differs from Humans in Causal Transfer
by: Xiang, Liangru, et al.
Published: (2026)

A simulation-heuristics dual-process model for intuitive physics
by: Li, Shiqian, et al.
Published: (2025)

Do Theory of Mind Benchmarks Need Explicit Human-like Reasoning in Language Models?
by: Lu, Yi-Long, et al.
Published: (2025)

OpenToM: A Comprehensive Benchmark for Evaluating Theory-of-Mind Reasoning Capabilities of Large Language Models
by: Xu, Hainiu, et al.
Published: (2024)

Automatic Cognitive Task Generation for In-Situ Evaluation of Embodied Agents
by: He, Xinyi, et al.
Published: (2026)

Word Embeddings Track Social Group Changes Across 70 Years in China
by: Ma, Yuxi, et al.
Published: (2025)

Brain in a Vat: On Missing Pieces Towards Artificial General Intelligence in Large Language Models
by: Ma, Yuxi, et al.
Published: (2023)

The Cognitive Capabilities of Generative AI: A Comparative Analysis with Human Benchmarks
by: Galatzer-Levy, Isaac R., et al.
Published: (2024)

A Comparative Study on Automatic Coding of Medical Letters with Explainability
by: Glen, Jamie, et al.
Published: (2024)

Nadine: An LLM-driven Intelligent Social Robot with Affective Capabilities and Human-like Memory
by: Kang, Hangyeol, et al.
Published: (2024)

Prioritizing High-Consequence Biological Capabilities in Evaluations of Artificial Intelligence Models
by: Pannu, Jaspreet, et al.
Published: (2024)

Evaluating Multimodal Large Language Models with Daily Composite Tasks in Home Environments
by: Zhang, Zhenliang, et al.
Published: (2025)

Large Language Model Powered Intelligent Urban Agents: Concepts, Capabilities, and Applications
by: Han, Jindong, et al.
Published: (2025)

How do Humans Process AI-generated Hallucination Contents: a Neuroimaging Study
by: Zhu, Shuqi, et al.
Published: (2026)

INSIGHTBUDDY-AI: Medication Extraction and Entity Linking using Large Language Models and Ensemble Learning
by: Romero, Pablo, et al.
Published: (2024)

Constrained Human-AI Cooperation: An Inclusive Embodied Social Intelligence Challenge
by: Du, Weihua, et al.
Published: (2024)

Probing and Inducing Combinational Creativity in Vision-Language Models
by: Peng, Yongqian, et al.
Published: (2025)

Explainable Ethical Assessment on Human Behaviors by Generating Conflicting Social Norms
by: Sun, Yuxi, et al.
Published: (2025)

DebugBench: Evaluating Debugging Capability of Large Language Models
by: Tian, Runchu, et al.
Published: (2024)

A Conceptual Framework for AI Capability Evaluations
by: Carro, María Victoria, et al.
Published: (2025)

LIFELONG SOTOPIA: Evaluating Social Intelligence of Language Agents Over Lifelong Social Interactions
by: Goel, Hitesh, et al.
Published: (2025)

Evaluating Human Alignment and Model Faithfulness of LLM Rationale
by: Fayyaz, Mohsen, et al.
Published: (2024)

Evaluating Human-AI Safety: A Framework for Measuring Harmful Capability Uplift
by: Vaccaro, Michelle, et al.
Published: (2026)

Evaluating the Architectural Reasoning Capabilities of LLM Provers via the Obfuscated Natural Number Game
by: Li, Lixing
Published: (2026)

Towards Human-AI Deliberation: Design and Evaluation of LLM-Empowered Deliberative AI for AI-Assisted Decision-Making
by: Ma, Shuai, et al.
Published: (2024)

DocPuzzle: A Process-Aware Benchmark for Evaluating Realistic Long-Context Reasoning Capabilities
by: Zhuang, Tianyi, et al.
Published: (2025)

Human and AI Perceptual Differences in Image Classification Errors
by: Liu, Minghao, et al.
Published: (2023)

Replicating Human Social Perception in Generative AI: Evaluating the Valence-Dominance Model
by: Gurkan, Necdet, et al.
Published: (2025)

Open-World Evaluations for Measuring Frontier AI Capabilities
by: Kapoor, Sayash, et al.
Published: (2026)

SciTrust 2.0: A Comprehensive Framework for Evaluating Trustworthiness of Large Language Models in Scientific Applications
by: Herron, Emily, et al.
Published: (2025)

Assessing Student Errors in Experimentation Using Artificial Intelligence and Large Language Models: A Comparative Study with Human Raters
by: Bewersdorff, Arne, et al.
Published: (2023)

LimiX: Unleashing Structured-Data Modeling Capability for Generalist Intelligence
by: Zhang, Xingxuan, et al.
Published: (2025)

MSDiagnosis: A Benchmark for Evaluating Large Language Models in Multi-Step Clinical Diagnosis
by: Hou, Ruihui, et al.
Published: (2024)

AI Gamestore: Scalable, Open-Ended Evaluation of Machine General Intelligence with Human Games
by: Ying, Lance, et al.
Published: (2026)

Exploring the Capability of ChatGPT to Reproduce Human Labels for Social Computing Tasks (Extended Version)
by: Zhu, Yiming, et al.
Published: (2024)

FoundaBench: Evaluating Chinese Fundamental Knowledge Capabilities of Large Language Models
by: Li, Wei, et al.
Published: (2024)

BugBlitz-AI: An Intelligent QA Assistant
by: Yao, Yi, et al.
Published: (2024)

Stop Before You Fail: Operational Capability Boundaries for Mitigating Unproductive Reasoning in Large Reasoning Models
by: Zhang, Qingjie, et al.
Published: (2025)

An Insight into Security Code Review with LLMs: Capabilities, Obstacles, and Influential Factors
by: Yu, Jiaxin, et al.
Published: (2024)