Saved in:
Bibliographic Details
Main Authors: Puri, Prateek, Hassler, Gabriel, Shenk, Anton, Katragadda, Sai
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2401.12509
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910306389721088
author Puri, Prateek
Hassler, Gabriel
Shenk, Anton
Katragadda, Sai
author_facet Puri, Prateek
Hassler, Gabriel
Shenk, Anton
Katragadda, Sai
contents We develop a simulation framework for studying misinformation spread within online social networks that blends agent-based modeling and natural language processing techniques. While many other agent-based simulations exist in this space, questions over their fidelity and generalization to existing networks in part hinders their ability to provide actionable insights. To partially address these concerns, we create a 'digital clone' of a known misinformation sharing network by downloading social media histories for over ten thousand of its users. We parse these histories to both extract the structure of the network and model the nuanced ways in which information is shared and spread among its members. Unlike many other agent-based methods in this space, information sharing between users in our framework is sensitive to topic of discussion, user preferences, and online community dynamics. To evaluate the fidelity of our method, we seed our cloned network with a set of posts recorded in the base network and compare propagation dynamics between the two, observing reasonable agreement across the twin networks over a variety of metrics. Lastly, we explore how the cloned network may serve as a flexible, low-cost testbed for misinformation countermeasure evaluation and red teaming analysis. We hope the tools explored here augment existing efforts in the space and unlock new opportunities for misinformation countermeasure evaluation, a field that may become increasingly important to consider with the anticipated rise of misinformation campaigns fueled by generative artificial intelligence.
format Preprint
id arxiv_https___arxiv_org_abs_2401_12509
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Digital cloning of online social networks for language-sensitive agent-based modeling of misinformation spread
Puri, Prateek
Hassler, Gabriel
Shenk, Anton
Katragadda, Sai
Social and Information Networks
Machine Learning
We develop a simulation framework for studying misinformation spread within online social networks that blends agent-based modeling and natural language processing techniques. While many other agent-based simulations exist in this space, questions over their fidelity and generalization to existing networks in part hinders their ability to provide actionable insights. To partially address these concerns, we create a 'digital clone' of a known misinformation sharing network by downloading social media histories for over ten thousand of its users. We parse these histories to both extract the structure of the network and model the nuanced ways in which information is shared and spread among its members. Unlike many other agent-based methods in this space, information sharing between users in our framework is sensitive to topic of discussion, user preferences, and online community dynamics. To evaluate the fidelity of our method, we seed our cloned network with a set of posts recorded in the base network and compare propagation dynamics between the two, observing reasonable agreement across the twin networks over a variety of metrics. Lastly, we explore how the cloned network may serve as a flexible, low-cost testbed for misinformation countermeasure evaluation and red teaming analysis. We hope the tools explored here augment existing efforts in the space and unlock new opportunities for misinformation countermeasure evaluation, a field that may become increasingly important to consider with the anticipated rise of misinformation campaigns fueled by generative artificial intelligence.
title Digital cloning of online social networks for language-sensitive agent-based modeling of misinformation spread
topic Social and Information Networks
Machine Learning
url https://arxiv.org/abs/2401.12509