Reporting Non-Consensual Intimate Media: An Audit Study of Deepfakes

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Qiwei, Li, Zhang, Shihui, Kasper, Andrew Timothy, Ashkinaze, Joshua, Eaton, Asia A., Schoenebeck, Sarita, Gilbert, Eric
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917779401080832
author Qiwei, Li
Zhang, Shihui
Kasper, Andrew Timothy
Ashkinaze, Joshua
Eaton, Asia A.
Schoenebeck, Sarita
Gilbert, Eric
author_facet Qiwei, Li
Zhang, Shihui
Kasper, Andrew Timothy
Ashkinaze, Joshua
Eaton, Asia A.
Schoenebeck, Sarita
Gilbert, Eric
contents Non-consensual intimate media (NCIM) inflicts significant harm. Currently, victim-survivors can use two mechanisms to report NCIM - as a non-consensual nudity violation or as copyright infringement. We conducted an audit study of takedown speed of NCIM reported to X (formerly Twitter) of both mechanisms. We uploaded 50 AI-generated nude images and reported half under X's "non-consensual nudity" reporting mechanism and half under its "copyright infringement" mechanism. The copyright condition resulted in successful image removal within 25 hours for all images (100% removal rate), while non-consensual nudity reports resulted in no image removal for over three weeks (0% removal rate). We stress the need for targeted legislation to regulate NCIM removal online. We also discuss ethical considerations for auditing NCIM on social platforms.
format Preprint
id arxiv_https___arxiv_org_abs_2409_12138
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Reporting Non-Consensual Intimate Media: An Audit Study of Deepfakes
Qiwei, Li
Zhang, Shihui
Kasper, Andrew Timothy
Ashkinaze, Joshua
Eaton, Asia A.
Schoenebeck, Sarita
Gilbert, Eric
Computers and Society
Non-consensual intimate media (NCIM) inflicts significant harm. Currently, victim-survivors can use two mechanisms to report NCIM - as a non-consensual nudity violation or as copyright infringement. We conducted an audit study of takedown speed of NCIM reported to X (formerly Twitter) of both mechanisms. We uploaded 50 AI-generated nude images and reported half under X's "non-consensual nudity" reporting mechanism and half under its "copyright infringement" mechanism. The copyright condition resulted in successful image removal within 25 hours for all images (100% removal rate), while non-consensual nudity reports resulted in no image removal for over three weeks (0% removal rate). We stress the need for targeted legislation to regulate NCIM removal online. We also discuss ethical considerations for auditing NCIM on social platforms.
title Reporting Non-Consensual Intimate Media: An Audit Study of Deepfakes
topic Computers and Society
url https://arxiv.org/abs/2409.12138