Evidence-Driven Marker Extraction for Social Media Suicide Risk Detection

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Adams, Carter, Carter, Caleb, Simmons, Jackson
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913707587534848
author Adams, Carter
Carter, Caleb
Simmons, Jackson
author_facet Adams, Carter
Carter, Caleb
Simmons, Jackson
contents Early detection of suicide risk from social media text is crucial for timely intervention. While Large Language Models (LLMs) offer promising capabilities in this domain, challenges remain in terms of interpretability and computational efficiency. This paper introduces Evidence-Driven LLM (ED-LLM), a novel approach for clinical marker extraction and suicide risk classification. ED-LLM employs a multi-task learning framework, jointly training a Mistral-7B based model to identify clinical marker spans and classify suicide risk levels. This evidence-driven strategy enhances interpretability by explicitly highlighting textual evidence supporting risk assessments. Evaluated on the CLPsych datasets, ED-LLM demonstrates competitive performance in risk classification and superior capability in clinical marker span identification compared to baselines including fine-tuned LLMs, traditional machine learning, and prompt-based methods. The results highlight the effectiveness of multi-task learning for interpretable and efficient LLM-based suicide risk assessment, paving the way for clinically relevant applications.
format Preprint
id arxiv_https___arxiv_org_abs_2502_18823
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Evidence-Driven Marker Extraction for Social Media Suicide Risk Detection
Adams, Carter
Carter, Caleb
Simmons, Jackson
Computation and Language
Early detection of suicide risk from social media text is crucial for timely intervention. While Large Language Models (LLMs) offer promising capabilities in this domain, challenges remain in terms of interpretability and computational efficiency. This paper introduces Evidence-Driven LLM (ED-LLM), a novel approach for clinical marker extraction and suicide risk classification. ED-LLM employs a multi-task learning framework, jointly training a Mistral-7B based model to identify clinical marker spans and classify suicide risk levels. This evidence-driven strategy enhances interpretability by explicitly highlighting textual evidence supporting risk assessments. Evaluated on the CLPsych datasets, ED-LLM demonstrates competitive performance in risk classification and superior capability in clinical marker span identification compared to baselines including fine-tuned LLMs, traditional machine learning, and prompt-based methods. The results highlight the effectiveness of multi-task learning for interpretable and efficient LLM-based suicide risk assessment, paving the way for clinically relevant applications.
title Evidence-Driven Marker Extraction for Social Media Suicide Risk Detection
topic Computation and Language
url https://arxiv.org/abs/2502.18823