Exploring Large Language Models for Detecting Mental Disorders
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866917053886103552 |
|---|---|
| author | Kuzmin, Gleb Strepetov, Petr Stankevich, Maksim Chudova, Natalia Shelmanov, Artem Smirnov, Ivan |
| author_facet | Kuzmin, Gleb Strepetov, Petr Stankevich, Maksim Chudova, Natalia Shelmanov, Artem Smirnov, Ivan |
| contents | This paper compares the effectiveness of traditional machine learning methods, encoder-based models, and large language models (LLMs) on the task of detecting depression and anxiety. Five Russian-language datasets were considered, each differing in format and in the method used to define the target pathology class. We tested AutoML models based on linguistic features, several variations of encoder-based Transformers such as BERT, and state-of-the-art LLMs as pathology classification models. The results demonstrated that LLMs outperform traditional methods, particularly on noisy and small datasets where training examples vary significantly in text length and genre. However, psycholinguistic features and encoder-based models can achieve performance comparable to language models when trained on texts from individuals with clinically confirmed depression, highlighting their potential effectiveness in targeted clinical applications. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_07129 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Exploring Large Language Models for Detecting Mental Disorders Kuzmin, Gleb Strepetov, Petr Stankevich, Maksim Chudova, Natalia Shelmanov, Artem Smirnov, Ivan Computation and Language Artificial Intelligence This paper compares the effectiveness of traditional machine learning methods, encoder-based models, and large language models (LLMs) on the task of detecting depression and anxiety. Five Russian-language datasets were considered, each differing in format and in the method used to define the target pathology class. We tested AutoML models based on linguistic features, several variations of encoder-based Transformers such as BERT, and state-of-the-art LLMs as pathology classification models. The results demonstrated that LLMs outperform traditional methods, particularly on noisy and small datasets where training examples vary significantly in text length and genre. However, psycholinguistic features and encoder-based models can achieve performance comparable to language models when trained on texts from individuals with clinically confirmed depression, highlighting their potential effectiveness in targeted clinical applications. |
| title | Exploring Large Language Models for Detecting Mental Disorders |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2410.07129 |