Exploring Machine Learning and Language Models for Multimodal Depression Detection

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Hong, Javier Si Zhao, Delaya, Timothy Zoe, Kit, Sherwyn Chan Yin, Ng, Pai Chet, Miao, Xiaoxiao
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914011102052352
author Hong, Javier Si Zhao
Delaya, Timothy Zoe
Kit, Sherwyn Chan Yin
Ng, Pai Chet
Miao, Xiaoxiao
author_facet Hong, Javier Si Zhao
Delaya, Timothy Zoe
Kit, Sherwyn Chan Yin
Ng, Pai Chet
Miao, Xiaoxiao
contents This paper presents our approach to the first Multimodal Personality-Aware Depression Detection Challenge, focusing on multimodal depression detection using machine learning and deep learning models. We explore and compare the performance of XGBoost, transformer-based architectures, and large language models (LLMs) on audio, video, and text features. Our results highlight the strengths and limitations of each type of model in capturing depression-related signals across modalities, offering insights into effective multimodal representation strategies for mental health prediction.
format Preprint
id arxiv_https___arxiv_org_abs_2508_20805
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Exploring Machine Learning and Language Models for Multimodal Depression Detection
Hong, Javier Si Zhao
Delaya, Timothy Zoe
Kit, Sherwyn Chan Yin
Ng, Pai Chet
Miao, Xiaoxiao
Computation and Language
Artificial Intelligence
Sound
This paper presents our approach to the first Multimodal Personality-Aware Depression Detection Challenge, focusing on multimodal depression detection using machine learning and deep learning models. We explore and compare the performance of XGBoost, transformer-based architectures, and large language models (LLMs) on audio, video, and text features. Our results highlight the strengths and limitations of each type of model in capturing depression-related signals across modalities, offering insights into effective multimodal representation strategies for mental health prediction.
title Exploring Machine Learning and Language Models for Multimodal Depression Detection
topic Computation and Language
Artificial Intelligence
Sound
url https://arxiv.org/abs/2508.20805