Measuring, Modeling, and Helping People Account for Privacy Risks in Online Self-Disclosures with AI

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Krsek, Isadora, Kabra, Anubha, Dou, Yao, Naous, Tarek, Dabbish, Laura A., Ritter, Alan, Xu, Wei, Das, Sauvik
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912161964490752
author Krsek, Isadora
Kabra, Anubha
Dou, Yao
Naous, Tarek
Dabbish, Laura A.
Ritter, Alan
Xu, Wei
Das, Sauvik
author_facet Krsek, Isadora
Kabra, Anubha
Dou, Yao
Naous, Tarek
Dabbish, Laura A.
Ritter, Alan
Xu, Wei
Das, Sauvik
contents In pseudonymous online fora like Reddit, the benefits of self-disclosure are often apparent to users (e.g., I can vent about my in-laws to understanding strangers), but the privacy risks are more abstract (e.g., will my partner be able to tell that this is me?). Prior work has sought to develop natural language processing (NLP) tools that help users identify potentially risky self-disclosures in their text, but none have been designed for or evaluated with the users they hope to protect. Absent this assessment, these tools will be limited by the social-technical gap: users need assistive tools that help them make informed decisions, not paternalistic tools that tell them to avoid self-disclosure altogether. To bridge this gap, we conducted a study with N = 21 Reddit users; we had them use a state-of-the-art NLP disclosure detection model on two of their authored posts and asked them questions to understand if and how the model helped, where it fell short, and how it could be improved to help them make more informed decisions. Despite its imperfections, users responded positively to the model and highlighted its use as a tool that can help them catch mistakes, inform them of risks they were unaware of, and encourage self-reflection. However, our work also shows how, to be useful and usable, AI for supporting privacy decision-making must account for posting context, disclosure norms, and users' lived threat models, and provide explanations that help contextualize detected risks.
format Preprint
id arxiv_https___arxiv_org_abs_2412_15047
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Measuring, Modeling, and Helping People Account for Privacy Risks in Online Self-Disclosures with AI
Krsek, Isadora
Kabra, Anubha
Dou, Yao
Naous, Tarek
Dabbish, Laura A.
Ritter, Alan
Xu, Wei
Das, Sauvik
Human-Computer Interaction
Artificial Intelligence
In pseudonymous online fora like Reddit, the benefits of self-disclosure are often apparent to users (e.g., I can vent about my in-laws to understanding strangers), but the privacy risks are more abstract (e.g., will my partner be able to tell that this is me?). Prior work has sought to develop natural language processing (NLP) tools that help users identify potentially risky self-disclosures in their text, but none have been designed for or evaluated with the users they hope to protect. Absent this assessment, these tools will be limited by the social-technical gap: users need assistive tools that help them make informed decisions, not paternalistic tools that tell them to avoid self-disclosure altogether. To bridge this gap, we conducted a study with N = 21 Reddit users; we had them use a state-of-the-art NLP disclosure detection model on two of their authored posts and asked them questions to understand if and how the model helped, where it fell short, and how it could be improved to help them make more informed decisions. Despite its imperfections, users responded positively to the model and highlighted its use as a tool that can help them catch mistakes, inform them of risks they were unaware of, and encourage self-reflection. However, our work also shows how, to be useful and usable, AI for supporting privacy decision-making must account for posting context, disclosure norms, and users' lived threat models, and provide explanations that help contextualize detected risks.
title Measuring, Modeling, and Helping People Account for Privacy Risks in Online Self-Disclosures with AI
topic Human-Computer Interaction
Artificial Intelligence
url https://arxiv.org/abs/2412.15047