Saved in:
Bibliographic Details
Main Authors: Basílio, Gustavo A., Pereira, Thiago B., Koerich, Alessandro L., Tavares, Hermano, Dias, Ludmila, Teixeira, Maria das Graças da S., Sousa, Rafael T., Hisatugu, Wilian H., Mota, Amanda S., Garcia, Anilton S., Galletta, Marco Aurélio K., Paixão, Thiago M.
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2410.05450
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916563627540480
author Basílio, Gustavo A.
Pereira, Thiago B.
Koerich, Alessandro L.
Tavares, Hermano
Dias, Ludmila
Teixeira, Maria das Graças da S.
Sousa, Rafael T.
Hisatugu, Wilian H.
Mota, Amanda S.
Garcia, Anilton S.
Galletta, Marco Aurélio K.
Paixão, Thiago M.
author_facet Basílio, Gustavo A.
Pereira, Thiago B.
Koerich, Alessandro L.
Tavares, Hermano
Dias, Ludmila
Teixeira, Maria das Graças da S.
Sousa, Rafael T.
Hisatugu, Wilian H.
Mota, Amanda S.
Garcia, Anilton S.
Galletta, Marco Aurélio K.
Paixão, Thiago M.
contents Major Depressive Disorder and anxiety disorders affect millions globally, contributing significantly to the burden of mental health issues. Early screening is crucial for effective intervention, as timely identification of mental health issues can significantly improve treatment outcomes. Artificial intelligence (AI) can be valuable for improving the screening of mental disorders, enabling early intervention and better treatment outcomes. AI-driven screening can leverage the analysis of multiple data sources, including facial features in digital images. However, existing methods often rely on controlled environments or specialized equipment, limiting their broad applicability. This study explores the potential of AI models for ubiquitous depression-anxiety screening given face-centric selfies. The investigation focuses on high-risk pregnant patients, a population that is particularly vulnerable to mental health issues. To cope with limited training data resulting from our clinical setup, pre-trained models were utilized in two different approaches: fine-tuning convolutional neural networks (CNNs) originally designed for facial expression recognition and employing vision-language models (VLMs) for zero-shot analysis of facial expressions. Experimental results indicate that the proposed VLM-based method significantly outperforms CNNs, achieving an accuracy of 77.6%. Although there is significant room for improvement, the results suggest that VLMs can be a promising approach for mental health screening.
format Preprint
id arxiv_https___arxiv_org_abs_2410_05450
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle AI-Driven Early Mental Health Screening: Analyzing Selfies of Pregnant Women
Basílio, Gustavo A.
Pereira, Thiago B.
Koerich, Alessandro L.
Tavares, Hermano
Dias, Ludmila
Teixeira, Maria das Graças da S.
Sousa, Rafael T.
Hisatugu, Wilian H.
Mota, Amanda S.
Garcia, Anilton S.
Galletta, Marco Aurélio K.
Paixão, Thiago M.
Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
Major Depressive Disorder and anxiety disorders affect millions globally, contributing significantly to the burden of mental health issues. Early screening is crucial for effective intervention, as timely identification of mental health issues can significantly improve treatment outcomes. Artificial intelligence (AI) can be valuable for improving the screening of mental disorders, enabling early intervention and better treatment outcomes. AI-driven screening can leverage the analysis of multiple data sources, including facial features in digital images. However, existing methods often rely on controlled environments or specialized equipment, limiting their broad applicability. This study explores the potential of AI models for ubiquitous depression-anxiety screening given face-centric selfies. The investigation focuses on high-risk pregnant patients, a population that is particularly vulnerable to mental health issues. To cope with limited training data resulting from our clinical setup, pre-trained models were utilized in two different approaches: fine-tuning convolutional neural networks (CNNs) originally designed for facial expression recognition and employing vision-language models (VLMs) for zero-shot analysis of facial expressions. Experimental results indicate that the proposed VLM-based method significantly outperforms CNNs, achieving an accuracy of 77.6%. Although there is significant room for improvement, the results suggest that VLMs can be a promising approach for mental health screening.
title AI-Driven Early Mental Health Screening: Analyzing Selfies of Pregnant Women
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2410.05450