Harmful Suicide Content Detection
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916330210328576 |
|---|---|
| author | Park, Kyumin Baik, Myung Jae Hwang, YeongJun Shin, Yen Lee, HoJae Lee, Ruda Lee, Sang Min Sun, Je Young Hannah Lee, Ah Rah Yoon, Si Yeun Lee, Dong-ho Moon, Jihyung Bak, JinYeong Cho, Kyunghyun Paik, Jong-Woo Park, Sungjoon |
| author_facet | Park, Kyumin Baik, Myung Jae Hwang, YeongJun Shin, Yen Lee, HoJae Lee, Ruda Lee, Sang Min Sun, Je Young Hannah Lee, Ah Rah Yoon, Si Yeun Lee, Dong-ho Moon, Jihyung Bak, JinYeong Cho, Kyunghyun Paik, Jong-Woo Park, Sungjoon |
| contents | Harmful suicide content on the Internet is a significant risk factor inducing suicidal thoughts and behaviors among vulnerable populations. Despite global efforts, existing resources are insufficient, specifically in high-risk regions like the Republic of Korea. Current research mainly focuses on understanding negative effects of such content or suicide risk in individuals, rather than on automatically detecting the harmfulness of content. To fill this gap, we introduce a harmful suicide content detection task for classifying online suicide content into five harmfulness levels. We develop a multi-modal benchmark and a task description document in collaboration with medical professionals, and leverage large language models (LLMs) to explore efficient methods for moderating such content. Our contributions include proposing a novel detection task, a multi-modal Korean benchmark with expert annotations, and suggesting strategies using LLMs to detect illegal and harmful content. Owing to the potential harm involved, we publicize our implementations and benchmark, incorporating an ethical verification process. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_13942 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Harmful Suicide Content Detection Park, Kyumin Baik, Myung Jae Hwang, YeongJun Shin, Yen Lee, HoJae Lee, Ruda Lee, Sang Min Sun, Je Young Hannah Lee, Ah Rah Yoon, Si Yeun Lee, Dong-ho Moon, Jihyung Bak, JinYeong Cho, Kyunghyun Paik, Jong-Woo Park, Sungjoon Computers and Society Artificial Intelligence Computation and Language Social and Information Networks Harmful suicide content on the Internet is a significant risk factor inducing suicidal thoughts and behaviors among vulnerable populations. Despite global efforts, existing resources are insufficient, specifically in high-risk regions like the Republic of Korea. Current research mainly focuses on understanding negative effects of such content or suicide risk in individuals, rather than on automatically detecting the harmfulness of content. To fill this gap, we introduce a harmful suicide content detection task for classifying online suicide content into five harmfulness levels. We develop a multi-modal benchmark and a task description document in collaboration with medical professionals, and leverage large language models (LLMs) to explore efficient methods for moderating such content. Our contributions include proposing a novel detection task, a multi-modal Korean benchmark with expert annotations, and suggesting strategies using LLMs to detect illegal and harmful content. Owing to the potential harm involved, we publicize our implementations and benchmark, incorporating an ethical verification process. |
| title | Harmful Suicide Content Detection |
| topic | Computers and Society Artificial Intelligence Computation and Language Social and Information Networks |
| url | https://arxiv.org/abs/2407.13942 |