How Social is It? A Benchmark for LLMs' Capabilities in Multi-user Multi-turn Social Agent Tasks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wu, Yusen, Xiong, Junwu, Deng, Xiaotie
Format:	Preprint
Published:	2025
Subjects:	Computation and Language Artificial Intelligence Social and Information Networks
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Assessing Capabilities of Large Language Models in Social Media Analytics: A Multi-task Quest
by: Davoudi, Ramtin, et al.
Published: (2026)

Implementing Long Text Style Transfer with LLMs through Dual-Layered Sentence and Paragraph Structure Extraction and Mapping
by: Wu, Yusen, et al.
Published: (2025)

MOSAIC: Modeling Social AI for Content Dissemination and Regulation in Multi-Agent Simulations
by: Liu, Genglin, et al.
Published: (2025)

SoMe: A Realistic Benchmark for LLM-based Social Media Agents
by: Xue, Dizhan, et al.
Published: (2025)

LLMs Prompted for Graphs: Hallucinations and Generative Capabilities
by: Richardeau, Gurvan, et al.
Published: (2024)

Leveraging Large Language Models for Multi-Class and Multi-Label Detection of Drug Use and Overdose Symptoms on Social Media
by: Ahmad, Muhammad, et al.
Published: (2025)

PERCEIVE: A Benchmark for Personalized Emotion and Communication Behavior Understanding on Social Media
by: Liao, Jian, et al.
Published: (2026)

Toward Culturally Aligned LLMs through Ontology-Guided Multi-Agent Reasoning
by: Seo, Wonduk, et al.
Published: (2026)

MASim: Multilingual Agent-Based Simulation for Social Science
by: Zhang, Xuan, et al.
Published: (2025)

Evolving to the Future: Unseen Event Adaptive Fake News Detection on Social Media
by: Zhang, Jiajun, et al.
Published: (2024)

Multi-Stakeholder Disaster Insights from Social Media Using Large Language Models
by: Belcastro, Loris, et al.
Published: (2025)

Network Formation and Dynamics Among Multi-LLMs
by: Papachristou, Marios, et al.
Published: (2024)

MultiSiam: A Multiple Input Siamese Network For Social Media Text Classification And Duplicate Text Detection
by: Bhoi, Sudhanshu, et al.
Published: (2024)

Post-hoc Study of Climate Microtargeting on Social Media Ads with LLMs: Thematic Insights and Fairness Evaluation
by: Islam, Tunazzina, et al.
Published: (2024)

Human Mobility Datasets Enriched With Contextual and Social Dimensions
by: Pugliese, Chiara, et al.
Published: (2025)

An Analytical Emotion Framework of Rumour Threads on Social Media
by: Xing, Rui, et al.
Published: (2025)

User-Aware Multilingual Abusive Content Detection in Social Media
by: Rehman, Mohammad Zia Ur, et al.
Published: (2024)

Suicide Risk Assessment on Social Media with Semi-Supervised Learning
by: Lovitt, Max, et al.
Published: (2024)

A Computational Framework for Interpretable Text-Based Personality Assessment from Social Media
by: Gjurković, Matej
Published: (2025)

AI-Gram: When Visual Agents Interact in a Social Network
by: Shin, Andrew
Published: (2026)

When AI Agents Collude Online: Financial Fraud Risks by Collaborative LLM Agents on Social Platforms
by: Ren, Qibing, et al.
Published: (2025)

Understanding Sarcoidosis Using Large Language Models and Social Media Data
by: Xi, Nan Miles, et al.
Published: (2024)

Measuring Social Media Polarization Using Large Language Models and Heuristic Rules
by: Chowdhury, Jawad, et al.
Published: (2026)

CSEval: Towards Automated, Multi-Dimensional, and Reference-Free Counterspeech Evaluation using Auto-Calibrated LLMs
by: Hengle, Amey, et al.
Published: (2025)

LLMTaxo: Leveraging Large Language Models for Constructing Taxonomy of Factual Claims from Social Media
by: Zhang, Haiqi, et al.
Published: (2025)

BEYONDWORDS is All You Need: Agentic Generative AI based Social Media Themes Extractor
by: Ghali, Mohammed-Khalil, et al.
Published: (2025)

Hate Speech Detection Using Cross-Platform Social Media Data In English and German Language
by: Shahi, Gautam Kishore, et al.
Published: (2024)

Large Language Models for Causal Relations Extraction in Social Media: A Validation Framework for Disaster Intelligence
by: Jeong, Ujun, et al.
Published: (2026)

Form Without Function: Agent Social Behavior in the Moltbook Network
by: Zerhoudi, Saber, et al.
Published: (2026)

Incentivizing News Consumption on Social Media Platforms Using Large Language Models and Realistic Bot Accounts
by: Askari, Hadi, et al.
Published: (2024)

Uncovering Latent Arguments in Social Media Messaging by Employing LLMs-in-the-Loop Strategy
by: Islam, Tunazzina, et al.
Published: (2024)

Discovering Latent Themes in Social Media Messaging: A Machine-in-the-Loop Approach Integrating LLMs
by: Islam, Tunazzina, et al.
Published: (2024)

A Multi-Stage Framework with Taxonomy-Guided Reasoning for Occupation Classification Using Large Language Models
by: Achananuparp, Palakorn, et al.
Published: (2025)

Classifying Problem and Solution Framing in Congressional Social Media
by: Melnyk, Misha, et al.
Published: (2026)

Algorithmic Cultivation: How Social Media Feeds Shape User Language
by: Pal, Olivia, et al.
Published: (2026)

Health Misinformation in Social Networks: A Survey of IT Approaches
by: Papanikou, Vasiliki, et al.
Published: (2024)

Detecting Synthetic Political Narratives in Cross-Platform Social Media Discourse
by: Antonakaki, Despoina, et al.
Published: (2026)

Leveraging Knowledge Graphs and LLMs for Structured Generation of Misinformation
by: Nayab, Sania, et al.
Published: (2025)

Transferring Structure Knowledge: A New Task to Fake news Detection Towards Cold-Start Propagation
by: Wei, Lingwei, et al.
Published: (2024)

Whom to Query for What: Adaptive Group Elicitation via Multi-Turn LLM Interactions
by: Ding, Ruomeng, et al.
Published: (2026)