@GrokSet: multi-party Human-LLM Interactions in Social Media
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2026
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866915815285063680 |
|---|---|
| author | Migliarini, Matteo Ercevik, Berat Olowe, Oluwagbemike Fatima, Saira Zhao, Sarah Le, Minh Anh Sharma, Vasu Panda, Ashwinee |
| author_facet | Migliarini, Matteo Ercevik, Berat Olowe, Oluwagbemike Fatima, Saira Zhao, Sarah Le, Minh Anh Sharma, Vasu Panda, Ashwinee |
| contents | Large Language Models (LLMs) are increasingly deployed as active participants on public social media platforms, yet their behavior in these unconstrained social environments remains largely unstudied. Existing datasets, drawn primarily from private chat interfaces, lack the multi-party dynamics and public visibility crucial for understanding real-world performance. To address this gap, we introduce @GrokSet, a large-scale dataset of over 1 million tweets involving the @Grok LLM on X. Our analysis reveals a distinct functional shift: rather than serving as a general assistant, the LLM is frequently invoked as an authoritative arbiter in high-stakes, polarizing political debates. However, we observe a persistent engagement gap: despite this visibility, the model functions as a low-status utility, receiving significantly less social validation (likes, replies) than human peers. Finally, we find that this adversarial context exposes shallow alignment: users bypass safety filters not through complex jailbreaks, but through simple persona adoption and tone mirroring. We release @GrokSet as a critical resource for studying the intersection of AI agents and societal discourse. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_21236 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | @GrokSet: multi-party Human-LLM Interactions in Social Media Migliarini, Matteo Ercevik, Berat Olowe, Oluwagbemike Fatima, Saira Zhao, Sarah Le, Minh Anh Sharma, Vasu Panda, Ashwinee Social and Information Networks Computers and Society Large Language Models (LLMs) are increasingly deployed as active participants on public social media platforms, yet their behavior in these unconstrained social environments remains largely unstudied. Existing datasets, drawn primarily from private chat interfaces, lack the multi-party dynamics and public visibility crucial for understanding real-world performance. To address this gap, we introduce @GrokSet, a large-scale dataset of over 1 million tweets involving the @Grok LLM on X. Our analysis reveals a distinct functional shift: rather than serving as a general assistant, the LLM is frequently invoked as an authoritative arbiter in high-stakes, polarizing political debates. However, we observe a persistent engagement gap: despite this visibility, the model functions as a low-status utility, receiving significantly less social validation (likes, replies) than human peers. Finally, we find that this adversarial context exposes shallow alignment: users bypass safety filters not through complex jailbreaks, but through simple persona adoption and tone mirroring. We release @GrokSet as a critical resource for studying the intersection of AI agents and societal discourse. |
| title | @GrokSet: multi-party Human-LLM Interactions in Social Media |
| topic | Social and Information Networks Computers and Society |
| url | https://arxiv.org/abs/2602.21236 |