Supervised Learning and Large Language Model Benchmarks on Mental Health Datasets: Cognitive Distortions and Suicidal Risks in Chinese Social Media

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Qi, Hongzhi, Zhao, Qing, Li, Jianqiang, Song, Changwei, Zhai, Wei, Luo, Dan, Liu, Shuo, Yu, Yi Jing, Wang, Fan, Zou, Huijing, Yang, Bing Xiang, Fu, Guanghui
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914829729529856
author Qi, Hongzhi
Zhao, Qing
Li, Jianqiang
Song, Changwei
Zhai, Wei
Luo, Dan
Liu, Shuo
Yu, Yi Jing
Wang, Fan
Zou, Huijing
Yang, Bing Xiang
Fu, Guanghui
author_facet Qi, Hongzhi
Zhao, Qing
Li, Jianqiang
Song, Changwei
Zhai, Wei
Luo, Dan
Liu, Shuo
Yu, Yi Jing
Wang, Fan
Zou, Huijing
Yang, Bing Xiang
Fu, Guanghui
contents On social media, users often express their personal feelings, which may exhibit cognitive distortions or even suicidal tendencies on certain specific topics. Early recognition of these signs is critical for effective psychological intervention. In this paper, we introduce two novel datasets from Chinese social media: SOS-HL-1K for suicidal risk classification and SocialCD-3K for cognitive distortions detection. The SOS-HL-1K dataset contained 1,249 posts and SocialCD-3K dataset was a multi-label classification dataset that containing 3,407 posts. We propose a comprehensive evaluation using two supervised learning methods and eight large language models (LLMs) on the proposed datasets. From the prompt engineering perspective, we experimented with two types of prompt strategies, including four zero-shot and five few-shot strategies. We also evaluated the performance of the LLMs after fine-tuning on the proposed tasks. The experimental results show that there is still a huge gap between LLMs relying only on prompt engineering and supervised learning. In the suicide classification task, this gap is 6.95% points in F1-score, while in the cognitive distortion task, the gap is even more pronounced, reaching 31.53% points in F1-score. However, after fine-tuning, this difference is significantly reduced. In the suicide and cognitive distortion classification tasks, the gap decreases to 4.31% and 3.14%, respectively. This research highlights the potential of LLMs in psychological contexts, but supervised learning remains necessary for more challenging tasks. All datasets and code are made available.
format Preprint
id arxiv_https___arxiv_org_abs_2309_03564
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Supervised Learning and Large Language Model Benchmarks on Mental Health Datasets: Cognitive Distortions and Suicidal Risks in Chinese Social Media
Qi, Hongzhi
Zhao, Qing
Li, Jianqiang
Song, Changwei
Zhai, Wei
Luo, Dan
Liu, Shuo
Yu, Yi Jing
Wang, Fan
Zou, Huijing
Yang, Bing Xiang
Fu, Guanghui
Computation and Language
Machine Learning
On social media, users often express their personal feelings, which may exhibit cognitive distortions or even suicidal tendencies on certain specific topics. Early recognition of these signs is critical for effective psychological intervention. In this paper, we introduce two novel datasets from Chinese social media: SOS-HL-1K for suicidal risk classification and SocialCD-3K for cognitive distortions detection. The SOS-HL-1K dataset contained 1,249 posts and SocialCD-3K dataset was a multi-label classification dataset that containing 3,407 posts. We propose a comprehensive evaluation using two supervised learning methods and eight large language models (LLMs) on the proposed datasets. From the prompt engineering perspective, we experimented with two types of prompt strategies, including four zero-shot and five few-shot strategies. We also evaluated the performance of the LLMs after fine-tuning on the proposed tasks. The experimental results show that there is still a huge gap between LLMs relying only on prompt engineering and supervised learning. In the suicide classification task, this gap is 6.95% points in F1-score, while in the cognitive distortion task, the gap is even more pronounced, reaching 31.53% points in F1-score. However, after fine-tuning, this difference is significantly reduced. In the suicide and cognitive distortion classification tasks, the gap decreases to 4.31% and 3.14%, respectively. This research highlights the potential of LLMs in psychological contexts, but supervised learning remains necessary for more challenging tasks. All datasets and code are made available.
title Supervised Learning and Large Language Model Benchmarks on Mental Health Datasets: Cognitive Distortions and Suicidal Risks in Chinese Social Media
topic Computation and Language
Machine Learning
url https://arxiv.org/abs/2309.03564