HarassGuard: Detecting Harassment Behaviors in Social Virtual Reality with Vision-Language Models

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Lee, Junhee, Kim, Minseok, Heo, Hwanjo, Woo, Seungwon, Kim, Jinwoo
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866910093393526784
author Lee, Junhee
Kim, Minseok
Heo, Hwanjo
Woo, Seungwon
Kim, Jinwoo
author_facet Lee, Junhee
Kim, Minseok
Heo, Hwanjo
Woo, Seungwon
Kim, Jinwoo
contents Social Virtual Reality (VR) platforms provide immersive social experiences but also expose users to serious risks of online harassment. Existing safety measures are largely reactive, while proactive solutions that detect harassment behavior during an incident often depend on sensitive biometric data, raising privacy concerns. In this paper, we present HarassGuard, a vision-language model (VLM) based system that detects physical harassment in social VR using only visual input. We construct an IRB-approved harassment vision dataset, apply prompt engineering, and fine-tune VLMs to detect harassment behavior by considering contextual information in social VR. Experimental results demonstrate that HarassGuard achieves competitive performance compared to state-of-the-art baselines (i.e., LSTM/CNN, Transformer), reaching an accuracy of up to 88.09% in binary classification and 68.85% in multi-class classification. Notably, HarassGuard matches these baselines while using significantly fewer fine-tuning samples (200 vs. 1,115), offering unique advantages in contextual reasoning and privacy-preserving detection.
format Preprint
id arxiv_https___arxiv_org_abs_2604_00592
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle HarassGuard: Detecting Harassment Behaviors in Social Virtual Reality with Vision-Language Models
Lee, Junhee
Kim, Minseok
Heo, Hwanjo
Woo, Seungwon
Kim, Jinwoo
Computer Vision and Pattern Recognition
Human-Computer Interaction
Social Virtual Reality (VR) platforms provide immersive social experiences but also expose users to serious risks of online harassment. Existing safety measures are largely reactive, while proactive solutions that detect harassment behavior during an incident often depend on sensitive biometric data, raising privacy concerns. In this paper, we present HarassGuard, a vision-language model (VLM) based system that detects physical harassment in social VR using only visual input. We construct an IRB-approved harassment vision dataset, apply prompt engineering, and fine-tune VLMs to detect harassment behavior by considering contextual information in social VR. Experimental results demonstrate that HarassGuard achieves competitive performance compared to state-of-the-art baselines (i.e., LSTM/CNN, Transformer), reaching an accuracy of up to 88.09% in binary classification and 68.85% in multi-class classification. Notably, HarassGuard matches these baselines while using significantly fewer fine-tuning samples (200 vs. 1,115), offering unique advantages in contextual reasoning and privacy-preserving detection.
title HarassGuard: Detecting Harassment Behaviors in Social Virtual Reality with Vision-Language Models
topic Computer Vision and Pattern Recognition
Human-Computer Interaction
url https://arxiv.org/abs/2604.00592