Deep functional multiple index models with an application to SER

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Saumard, Matthieu, Haj, Abir El, Napoleon, Thibault
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866929289323085824
author Saumard, Matthieu
Haj, Abir El
Napoleon, Thibault
author_facet Saumard, Matthieu
Haj, Abir El
Napoleon, Thibault
contents Speech Emotion Recognition (SER) plays a crucial role in advancing human-computer interaction and speech processing capabilities. We introduce a novel deep-learning architecture designed specifically for the functional data model known as the multiple-index functional model. Our key innovation lies in integrating adaptive basis layers and an automated data transformation search within the deep learning framework. Simulations for this new model show good performances. This allows us to extract features tailored for chunk-level SER, based on Mel Frequency Cepstral Coefficients (MFCCs). We demonstrate the effectiveness of our approach on the benchmark IEMOCAP database, achieving good performance compared to existing methods.
format Preprint
id arxiv_https___arxiv_org_abs_2403_17562
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Deep functional multiple index models with an application to SER
Saumard, Matthieu
Haj, Abir El
Napoleon, Thibault
Sound
Audio and Speech Processing
Applications
Speech Emotion Recognition (SER) plays a crucial role in advancing human-computer interaction and speech processing capabilities. We introduce a novel deep-learning architecture designed specifically for the functional data model known as the multiple-index functional model. Our key innovation lies in integrating adaptive basis layers and an automated data transformation search within the deep learning framework. Simulations for this new model show good performances. This allows us to extract features tailored for chunk-level SER, based on Mel Frequency Cepstral Coefficients (MFCCs). We demonstrate the effectiveness of our approach on the benchmark IEMOCAP database, achieving good performance compared to existing methods.
title Deep functional multiple index models with an application to SER
topic Sound
Audio and Speech Processing
Applications
url https://arxiv.org/abs/2403.17562