Emotional Voice Messages (EMOVOME) database: emotion recognition in spontaneous voice messages
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866929384051441664 |
|---|---|
| author | Zaragozá, Lucía Gómez del Amor, Rocío Vargas, Elena Parra Naranjo, Valery Raya, Mariano Alcañiz Marín-Morales, Javier |
| author_facet | Zaragozá, Lucía Gómez del Amor, Rocío Vargas, Elena Parra Naranjo, Valery Raya, Mariano Alcañiz Marín-Morales, Javier |
| contents | Emotional Voice Messages (EMOVOME) is a spontaneous speech dataset containing 999 audio messages from real conversations on a messaging app from 100 Spanish speakers, gender balanced. Voice messages were produced in-the-wild conditions before participants were recruited, avoiding any conscious bias due to laboratory environment. Audios were labeled in valence and arousal dimensions by three non-experts and two experts, which were then combined to obtain a final label per dimension. The experts also provided an extra label corresponding to seven emotion categories. To set a baseline for future investigations using EMOVOME, we implemented emotion recognition models using both speech and audio transcriptions. For speech, we used the standard eGeMAPS feature set and support vector machines, obtaining 49.27% and 44.71% unweighted accuracy for valence and arousal respectively. For text, we fine-tuned a multilingual BERT model and achieved 61.15% and 47.43% unweighted accuracy for valence and arousal respectively. This database will significantly contribute to research on emotion recognition in the wild, while also providing a unique natural and freely accessible resource for Spanish. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_17496 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Emotional Voice Messages (EMOVOME) database: emotion recognition in spontaneous voice messages Zaragozá, Lucía Gómez del Amor, Rocío Vargas, Elena Parra Naranjo, Valery Raya, Mariano Alcañiz Marín-Morales, Javier Sound Artificial Intelligence Computation and Language Audio and Speech Processing I.5.1; I.5.4; I.2.7 Emotional Voice Messages (EMOVOME) is a spontaneous speech dataset containing 999 audio messages from real conversations on a messaging app from 100 Spanish speakers, gender balanced. Voice messages were produced in-the-wild conditions before participants were recruited, avoiding any conscious bias due to laboratory environment. Audios were labeled in valence and arousal dimensions by three non-experts and two experts, which were then combined to obtain a final label per dimension. The experts also provided an extra label corresponding to seven emotion categories. To set a baseline for future investigations using EMOVOME, we implemented emotion recognition models using both speech and audio transcriptions. For speech, we used the standard eGeMAPS feature set and support vector machines, obtaining 49.27% and 44.71% unweighted accuracy for valence and arousal respectively. For text, we fine-tuned a multilingual BERT model and achieved 61.15% and 47.43% unweighted accuracy for valence and arousal respectively. This database will significantly contribute to research on emotion recognition in the wild, while also providing a unique natural and freely accessible resource for Spanish. |
| title | Emotional Voice Messages (EMOVOME) database: emotion recognition in spontaneous voice messages |
| topic | Sound Artificial Intelligence Computation and Language Audio and Speech Processing I.5.1; I.5.4; I.2.7 |
| url | https://arxiv.org/abs/2402.17496 |