Web-Browsing LLMs Can Access Social Media Profiles and Infer User Demographics

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Alizadeh, Meysam, Gilardi, Fabrizio, Samei, Zeynab, Mosleh, Mohsen
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912486179995648
author Alizadeh, Meysam
Gilardi, Fabrizio
Samei, Zeynab
Mosleh, Mohsen
author_facet Alizadeh, Meysam
Gilardi, Fabrizio
Samei, Zeynab
Mosleh, Mohsen
contents Large language models (LLMs) have traditionally relied on static training data, limiting their knowledge to fixed snapshots. Recent advancements, however, have equipped LLMs with web browsing capabilities, enabling real time information retrieval and multi step reasoning over live web content. While prior studies have demonstrated LLMs ability to access and analyze websites, their capacity to directly retrieve and analyze social media data remains unexplored. Here, we evaluate whether web browsing LLMs can infer demographic attributes of social media users given only their usernames. Using a synthetic dataset of 48 X (Twitter) accounts and a survey dataset of 1,384 international participants, we show that these models can access social media content and predict user demographics with reasonable accuracy. Analysis of the synthetic dataset further reveals how LLMs parse and interpret social media profiles, which may introduce gender and political biases against accounts with minimal activity. While this capability holds promise for computational social science in the post API era, it also raises risks of misuse particularly in information operations and targeted advertising underscoring the need for safeguards. We recommend that LLM providers restrict this capability in public facing applications, while preserving controlled access for verified research purposes.
format Preprint
id arxiv_https___arxiv_org_abs_2507_12372
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Web-Browsing LLMs Can Access Social Media Profiles and Infer User Demographics
Alizadeh, Meysam
Gilardi, Fabrizio
Samei, Zeynab
Mosleh, Mohsen
Computation and Language
Large language models (LLMs) have traditionally relied on static training data, limiting their knowledge to fixed snapshots. Recent advancements, however, have equipped LLMs with web browsing capabilities, enabling real time information retrieval and multi step reasoning over live web content. While prior studies have demonstrated LLMs ability to access and analyze websites, their capacity to directly retrieve and analyze social media data remains unexplored. Here, we evaluate whether web browsing LLMs can infer demographic attributes of social media users given only their usernames. Using a synthetic dataset of 48 X (Twitter) accounts and a survey dataset of 1,384 international participants, we show that these models can access social media content and predict user demographics with reasonable accuracy. Analysis of the synthetic dataset further reveals how LLMs parse and interpret social media profiles, which may introduce gender and political biases against accounts with minimal activity. While this capability holds promise for computational social science in the post API era, it also raises risks of misuse particularly in information operations and targeted advertising underscoring the need for safeguards. We recommend that LLM providers restrict this capability in public facing applications, while preserving controlled access for verified research purposes.
title Web-Browsing LLMs Can Access Social Media Profiles and Infer User Demographics
topic Computation and Language
url https://arxiv.org/abs/2507.12372