Understanding Student Sentiment on Mental Health Support in Colleges Using Large Language Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Sood, Palak, He, Chengyang, Gupta, Divyanshu, Ning, Yue, Wang, Ping
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909417568468992
author Sood, Palak
He, Chengyang
Gupta, Divyanshu
Ning, Yue
Wang, Ping
author_facet Sood, Palak
He, Chengyang
Gupta, Divyanshu
Ning, Yue
Wang, Ping
contents Mental health support in colleges is vital in educating students by offering counseling services and organizing supportive events. However, evaluating its effectiveness faces challenges like data collection difficulties and lack of standardized metrics, limiting research scope. Student feedback is crucial for evaluation but often relies on qualitative analysis without systematic investigation using advanced machine learning methods. This paper uses public Student Voice Survey data to analyze student sentiments on mental health support with large language models (LLMs). We created a sentiment analysis dataset, SMILE-College, with human-machine collaboration. The investigation of both traditional machine learning methods and state-of-the-art LLMs showed the best performance of GPT-3.5 and BERT on this new dataset. The analysis highlights challenges in accurately predicting response sentiments and offers practical insights on how LLMs can enhance mental health-related research and improve college mental health services. This data-driven approach will facilitate efficient and informed mental health support evaluation, management, and decision-making.
format Preprint
id arxiv_https___arxiv_org_abs_2412_04326
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Understanding Student Sentiment on Mental Health Support in Colleges Using Large Language Models
Sood, Palak
He, Chengyang
Gupta, Divyanshu
Ning, Yue
Wang, Ping
Computation and Language
Artificial Intelligence
Computers and Society
Mental health support in colleges is vital in educating students by offering counseling services and organizing supportive events. However, evaluating its effectiveness faces challenges like data collection difficulties and lack of standardized metrics, limiting research scope. Student feedback is crucial for evaluation but often relies on qualitative analysis without systematic investigation using advanced machine learning methods. This paper uses public Student Voice Survey data to analyze student sentiments on mental health support with large language models (LLMs). We created a sentiment analysis dataset, SMILE-College, with human-machine collaboration. The investigation of both traditional machine learning methods and state-of-the-art LLMs showed the best performance of GPT-3.5 and BERT on this new dataset. The analysis highlights challenges in accurately predicting response sentiments and offers practical insights on how LLMs can enhance mental health-related research and improve college mental health services. This data-driven approach will facilitate efficient and informed mental health support evaluation, management, and decision-making.
title Understanding Student Sentiment on Mental Health Support in Colleges Using Large Language Models
topic Computation and Language
Artificial Intelligence
Computers and Society
url https://arxiv.org/abs/2412.04326