SINAI at eRisk@CLEF 2025: Transformer-Based and Conversational Strategies for Depression Detection

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Marmol-Romero, Alba Maria, Garcia-Vega, Manuel, Garcia-Cumbreras, Miguel Angel, Montejo-Raez, Arturo
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866911173234917376
author Marmol-Romero, Alba Maria
Garcia-Vega, Manuel
Garcia-Cumbreras, Miguel Angel
Montejo-Raez, Arturo
author_facet Marmol-Romero, Alba Maria
Garcia-Vega, Manuel
Garcia-Cumbreras, Miguel Angel
Montejo-Raez, Arturo
contents This paper describes the participation of the SINAI-UJA team in the eRisk@CLEF 2025 lab. Specifically, we addressed two of the proposed tasks: (i) Task 2: Contextualized Early Detection of Depression, and (ii) Pilot Task: Conversational Depression Detection via LLMs. Our approach for Task 2 combines an extensive preprocessing pipeline with the use of several transformer-based models, such as RoBERTa Base or MentalRoBERTA Large, to capture the contextual and sequential nature of multi-user conversations. For the Pilot Task, we designed a set of conversational strategies to interact with LLM-powered personas, focusing on maximizing information gain within a limited number of dialogue turns. In Task 2, our system ranked 8th out of 12 participating teams based on F1 score. However, a deeper analysis revealed that our models were among the fastest in issuing early predictions, which is a critical factor in real-world deployment scenarios. This highlights the trade-off between early detection and classification accuracy, suggesting potential avenues for optimizing both jointly in future work. In the Pilot Task, we achieved 1st place out of 5 teams, obtaining the best overall performance across all evaluation metrics: DCHR, ADODL and ASHR. Our success in this task demonstrates the effectiveness of structured conversational design when combined with powerful language models, reinforcing the feasibility of deploying LLMs in sensitive mental health assessment contexts.
format Preprint
id arxiv_https___arxiv_org_abs_2509_19861
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle SINAI at eRisk@CLEF 2025: Transformer-Based and Conversational Strategies for Depression Detection
Marmol-Romero, Alba Maria
Garcia-Vega, Manuel
Garcia-Cumbreras, Miguel Angel
Montejo-Raez, Arturo
Computation and Language
This paper describes the participation of the SINAI-UJA team in the eRisk@CLEF 2025 lab. Specifically, we addressed two of the proposed tasks: (i) Task 2: Contextualized Early Detection of Depression, and (ii) Pilot Task: Conversational Depression Detection via LLMs. Our approach for Task 2 combines an extensive preprocessing pipeline with the use of several transformer-based models, such as RoBERTa Base or MentalRoBERTA Large, to capture the contextual and sequential nature of multi-user conversations. For the Pilot Task, we designed a set of conversational strategies to interact with LLM-powered personas, focusing on maximizing information gain within a limited number of dialogue turns. In Task 2, our system ranked 8th out of 12 participating teams based on F1 score. However, a deeper analysis revealed that our models were among the fastest in issuing early predictions, which is a critical factor in real-world deployment scenarios. This highlights the trade-off between early detection and classification accuracy, suggesting potential avenues for optimizing both jointly in future work. In the Pilot Task, we achieved 1st place out of 5 teams, obtaining the best overall performance across all evaluation metrics: DCHR, ADODL and ASHR. Our success in this task demonstrates the effectiveness of structured conversational design when combined with powerful language models, reinforcing the feasibility of deploying LLMs in sensitive mental health assessment contexts.
title SINAI at eRisk@CLEF 2025: Transformer-Based and Conversational Strategies for Depression Detection
topic Computation and Language
url https://arxiv.org/abs/2509.19861