Integrating Supervised Extractive and Generative Language Models for Suicide Risk Evidence Summarization

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Tanaka, Rika, Fukazawa, Yusuke
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866911810520612864
author Tanaka, Rika
Fukazawa, Yusuke
author_facet Tanaka, Rika
Fukazawa, Yusuke
contents We propose a method that integrates supervised extractive and generative language models for providing supporting evidence of suicide risk in the CLPsych 2024 shared task. Our approach comprises three steps. Initially, we construct a BERT-based model for estimating sentence-level suicide risk and negative sentiment. Next, we precisely identify high suicide risk sentences by emphasizing elevated probabilities of both suicide risk and negative sentiment. Finally, we integrate generative summaries using the MentaLLaMa framework and extractive summaries from identified high suicide risk sentences and a specialized dictionary of suicidal risk words. SophiaADS, our team, achieved 1st place for highlight extraction and ranked 10th for summary generation, both based on recall and consistency metrics, respectively.
format Preprint
id arxiv_https___arxiv_org_abs_2403_15478
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Integrating Supervised Extractive and Generative Language Models for Suicide Risk Evidence Summarization
Tanaka, Rika
Fukazawa, Yusuke
Computation and Language
We propose a method that integrates supervised extractive and generative language models for providing supporting evidence of suicide risk in the CLPsych 2024 shared task. Our approach comprises three steps. Initially, we construct a BERT-based model for estimating sentence-level suicide risk and negative sentiment. Next, we precisely identify high suicide risk sentences by emphasizing elevated probabilities of both suicide risk and negative sentiment. Finally, we integrate generative summaries using the MentaLLaMa framework and extractive summaries from identified high suicide risk sentences and a specialized dictionary of suicidal risk words. SophiaADS, our team, achieved 1st place for highlight extraction and ranked 10th for summary generation, both based on recall and consistency metrics, respectively.
title Integrating Supervised Extractive and Generative Language Models for Suicide Risk Evidence Summarization
topic Computation and Language
url https://arxiv.org/abs/2403.15478