ComFeAT: Combination of Neural and Spectral Features for Improved Depression Detection

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Phukan, Orchid Chetia, Jain, Sarthak, Singh, Shubham, Singh, Muskaan, Buduru, Arun Balaji, Sharma, Rajesh
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866914831179710464
author Phukan, Orchid Chetia
Jain, Sarthak
Singh, Shubham
Singh, Muskaan
Buduru, Arun Balaji
Sharma, Rajesh
author_facet Phukan, Orchid Chetia
Jain, Sarthak
Singh, Shubham
Singh, Muskaan
Buduru, Arun Balaji
Sharma, Rajesh
contents In this work, we focus on the detection of depression through speech analysis. Previous research has widely explored features extracted from pre-trained models (PTMs) primarily trained for paralinguistic tasks. Although these features have led to sufficient advances in speech-based depression detection, their performance declines in real-world settings. To address this, in this paper, we introduce ComFeAT, an application that employs a CNN model trained on a combination of features extracted from PTMs, a.k.a. neural features and spectral features to enhance depression detection. Spectral features are robust to domain variations, but, they are not as good as neural features in performance, suprisingly, combining them shows complementary behavior and improves over both neural and spectral features individually. The proposed method also improves over previous state-of-the-art (SOTA) works on E-DAIC benchmark.
format Preprint
id arxiv_https___arxiv_org_abs_2406_06774
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle ComFeAT: Combination of Neural and Spectral Features for Improved Depression Detection
Phukan, Orchid Chetia
Jain, Sarthak
Singh, Shubham
Singh, Muskaan
Buduru, Arun Balaji
Sharma, Rajesh
Audio and Speech Processing
Sound
In this work, we focus on the detection of depression through speech analysis. Previous research has widely explored features extracted from pre-trained models (PTMs) primarily trained for paralinguistic tasks. Although these features have led to sufficient advances in speech-based depression detection, their performance declines in real-world settings. To address this, in this paper, we introduce ComFeAT, an application that employs a CNN model trained on a combination of features extracted from PTMs, a.k.a. neural features and spectral features to enhance depression detection. Spectral features are robust to domain variations, but, they are not as good as neural features in performance, suprisingly, combining them shows complementary behavior and improves over both neural and spectral features individually. The proposed method also improves over previous state-of-the-art (SOTA) works on E-DAIC benchmark.
title ComFeAT: Combination of Neural and Spectral Features for Improved Depression Detection
topic Audio and Speech Processing
Sound
url https://arxiv.org/abs/2406.06774