VLM as Policy: Common-Law Content Moderation Framework for Short Video Platform
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866909586247647232 |
|---|---|
| author | Lu, Xingyu Zhang, Tianke Meng, Chang Wang, Xiaobei Wang, Jinpeng Zhang, YiFan Tang, Shisong Liu, Changyi Ding, Haojie Jiang, Kaiyu Tang, Kaiyu Wen, Bin Zheng, Hai-Tao Yang, Fan Gao, Tingting Zhang, Di Gai, Kun |
| author_facet | Lu, Xingyu Zhang, Tianke Meng, Chang Wang, Xiaobei Wang, Jinpeng Zhang, YiFan Tang, Shisong Liu, Changyi Ding, Haojie Jiang, Kaiyu Tang, Kaiyu Wen, Bin Zheng, Hai-Tao Yang, Fan Gao, Tingting Zhang, Di Gai, Kun |
| contents | Exponentially growing short video platforms (SVPs) face significant challenges in moderating content detrimental to users' mental health, particularly for minors. The dissemination of such content on SVPs can lead to catastrophic societal consequences. Although substantial efforts have been dedicated to moderating such content, existing methods suffer from critical limitations: (1) Manual review is prone to human bias and incurs high operational costs. (2) Automated methods, though efficient, lack nuanced content understanding, resulting in lower accuracy. (3) Industrial moderation regulations struggle to adapt to rapidly evolving trends due to long update cycles. In this paper, we annotate the first SVP content moderation benchmark with authentic user/reviewer feedback to fill the absence of benchmark in this field. Then we evaluate various methods on the benchmark to verify the existence of the aforementioned limitations. We further propose our common-law content moderation framework named KuaiMod to address these challenges. KuaiMod consists of three components: training data construction, offline adaptation, and online deployment & refinement. Leveraging large vision language model (VLM) and Chain-of-Thought (CoT) reasoning, KuaiMod adequately models video toxicity based on sparse user feedback and fosters dynamic moderation policy with rapid update speed and high accuracy. Offline experiments and large-scale online A/B test demonstrates the superiority of KuaiMod: KuaiMod achieves the best moderation performance on our benchmark. The deployment of KuaiMod reduces the user reporting rate by 20% and its application in video recommendation increases both Daily Active User (DAU) and APP Usage Time (AUT) on several Kuaishou scenarios. We have open-sourced our benchmark at https://kuaimod.github.io. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_14904 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | VLM as Policy: Common-Law Content Moderation Framework for Short Video Platform Lu, Xingyu Zhang, Tianke Meng, Chang Wang, Xiaobei Wang, Jinpeng Zhang, YiFan Tang, Shisong Liu, Changyi Ding, Haojie Jiang, Kaiyu Tang, Kaiyu Wen, Bin Zheng, Hai-Tao Yang, Fan Gao, Tingting Zhang, Di Gai, Kun Social and Information Networks Artificial Intelligence Computation and Language Multimedia Exponentially growing short video platforms (SVPs) face significant challenges in moderating content detrimental to users' mental health, particularly for minors. The dissemination of such content on SVPs can lead to catastrophic societal consequences. Although substantial efforts have been dedicated to moderating such content, existing methods suffer from critical limitations: (1) Manual review is prone to human bias and incurs high operational costs. (2) Automated methods, though efficient, lack nuanced content understanding, resulting in lower accuracy. (3) Industrial moderation regulations struggle to adapt to rapidly evolving trends due to long update cycles. In this paper, we annotate the first SVP content moderation benchmark with authentic user/reviewer feedback to fill the absence of benchmark in this field. Then we evaluate various methods on the benchmark to verify the existence of the aforementioned limitations. We further propose our common-law content moderation framework named KuaiMod to address these challenges. KuaiMod consists of three components: training data construction, offline adaptation, and online deployment & refinement. Leveraging large vision language model (VLM) and Chain-of-Thought (CoT) reasoning, KuaiMod adequately models video toxicity based on sparse user feedback and fosters dynamic moderation policy with rapid update speed and high accuracy. Offline experiments and large-scale online A/B test demonstrates the superiority of KuaiMod: KuaiMod achieves the best moderation performance on our benchmark. The deployment of KuaiMod reduces the user reporting rate by 20% and its application in video recommendation increases both Daily Active User (DAU) and APP Usage Time (AUT) on several Kuaishou scenarios. We have open-sourced our benchmark at https://kuaimod.github.io. |
| title | VLM as Policy: Common-Law Content Moderation Framework for Short Video Platform |
| topic | Social and Information Networks Artificial Intelligence Computation and Language Multimedia |
| url | https://arxiv.org/abs/2504.14904 |