Psychological Assessments with Large Language Models: A Privacy-Focused and Cost-Effective Approach

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
1. Verfasser: Blanco-Cuaresma, Sergi
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866911771326939136
author Blanco-Cuaresma, Sergi
author_facet Blanco-Cuaresma, Sergi
contents This study explores the use of Large Language Models (LLMs) to analyze text comments from Reddit users, aiming to achieve two primary objectives: firstly, to pinpoint critical excerpts that support a predefined psychological assessment of suicidal risk; and secondly, to summarize the material to substantiate the preassigned suicidal risk level. The work is circumscribed to the use of "open-source" LLMs that can be run locally, thereby enhancing data privacy. Furthermore, it prioritizes models with low computational requirements, making it accessible to both individuals and institutions operating on limited computing budgets. The implemented strategy only relies on a carefully crafted prompt and a grammar to guide the LLM's text completion. Despite its simplicity, the evaluation metrics show outstanding results, making it a valuable privacy-focused and cost-effective approach. This work is part of the Computational Linguistics and Clinical Psychology (CLPsych) 2024 shared task.
format Preprint
id arxiv_https___arxiv_org_abs_2402_03435
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Psychological Assessments with Large Language Models: A Privacy-Focused and Cost-Effective Approach
Blanco-Cuaresma, Sergi
Computation and Language
Artificial Intelligence
Computers and Society
This study explores the use of Large Language Models (LLMs) to analyze text comments from Reddit users, aiming to achieve two primary objectives: firstly, to pinpoint critical excerpts that support a predefined psychological assessment of suicidal risk; and secondly, to summarize the material to substantiate the preassigned suicidal risk level. The work is circumscribed to the use of "open-source" LLMs that can be run locally, thereby enhancing data privacy. Furthermore, it prioritizes models with low computational requirements, making it accessible to both individuals and institutions operating on limited computing budgets. The implemented strategy only relies on a carefully crafted prompt and a grammar to guide the LLM's text completion. Despite its simplicity, the evaluation metrics show outstanding results, making it a valuable privacy-focused and cost-effective approach. This work is part of the Computational Linguistics and Clinical Psychology (CLPsych) 2024 shared task.
title Psychological Assessments with Large Language Models: A Privacy-Focused and Cost-Effective Approach
topic Computation and Language
Artificial Intelligence
Computers and Society
url https://arxiv.org/abs/2402.03435