Collab: Fostering Critical Identification of Deepfake Videos on Social Media via Synergistic Annotation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Zhang, Shuning, Wang, Linzhi, Li, Shixuan, Wu, Yuanyuan, Chuai, Yuwei, Chen, Luoxi, Yi, Xin, Li, Hewu
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917220663164928
author Zhang, Shuning
Wang, Linzhi
Li, Shixuan
Wu, Yuanyuan
Chuai, Yuwei
Chen, Luoxi
Yi, Xin
Li, Hewu
author_facet Zhang, Shuning
Wang, Linzhi
Li, Shixuan
Wu, Yuanyuan
Chuai, Yuwei
Chen, Luoxi
Yi, Xin
Li, Hewu
contents Identifying deepfake videos on social media platforms is challenged by dynamic spatio-temporal artifacts and inadequate user tools. This hinders both critical viewing by users and scalable moderation on platforms. Here, we present Collab, a web plugin enabling users to collaboratively annotate deepfake videos. Collab integrates three key components: (i) an intuitive interface for spatio-temporal labeling where users provide confidence scores and rationales, facilitating detailed input even from non-experts, (ii) a novel confidence-weighted spatio-temporal Intersection-over-Union (IoU) algorithm to aggregate diverse user annotations into accurate aggregations, and (iii) a hierarchical demonstration strategy presenting aggregated results to guide attention toward contentious regions and foster critical evaluation. A seven-day online study (N=90), where participants annotated suspicious videos when viewing an online experimental platforms, compared Collab against two conditions without aggregation or demonstration respectively. Collab significantly improved identification accuracy and enhanced reflection compared to non-demonstration condition, while outperforming non-aggregation condition for its novelty and effectiveness.
format Preprint
id arxiv_https___arxiv_org_abs_2601_17371
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Collab: Fostering Critical Identification of Deepfake Videos on Social Media via Synergistic Annotation
Zhang, Shuning
Wang, Linzhi
Li, Shixuan
Wu, Yuanyuan
Chuai, Yuwei
Chen, Luoxi
Yi, Xin
Li, Hewu
Human-Computer Interaction
Identifying deepfake videos on social media platforms is challenged by dynamic spatio-temporal artifacts and inadequate user tools. This hinders both critical viewing by users and scalable moderation on platforms. Here, we present Collab, a web plugin enabling users to collaboratively annotate deepfake videos. Collab integrates three key components: (i) an intuitive interface for spatio-temporal labeling where users provide confidence scores and rationales, facilitating detailed input even from non-experts, (ii) a novel confidence-weighted spatio-temporal Intersection-over-Union (IoU) algorithm to aggregate diverse user annotations into accurate aggregations, and (iii) a hierarchical demonstration strategy presenting aggregated results to guide attention toward contentious regions and foster critical evaluation. A seven-day online study (N=90), where participants annotated suspicious videos when viewing an online experimental platforms, compared Collab against two conditions without aggregation or demonstration respectively. Collab significantly improved identification accuracy and enhanced reflection compared to non-demonstration condition, while outperforming non-aggregation condition for its novelty and effectiveness.
title Collab: Fostering Critical Identification of Deepfake Videos on Social Media via Synergistic Annotation
topic Human-Computer Interaction
url https://arxiv.org/abs/2601.17371