Mouth Articulation-Based Anchoring for Improved Cross-Corpus Speech Emotion Recognition
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866929651096485888 |
|---|---|
| author | Upadhyay, Shreya G. Salman, Ali N. Busso, Carlos Lee, Chi-Chun |
| author_facet | Upadhyay, Shreya G. Salman, Ali N. Busso, Carlos Lee, Chi-Chun |
| contents | Cross-corpus speech emotion recognition (SER) plays a vital role in numerous practical applications. Traditional approaches to cross-corpus emotion transfer often concentrate on adapting acoustic features to align with different corpora, domains, or labels. However, acoustic features are inherently variable and error-prone due to factors like speaker differences, domain shifts, and recording conditions. To address these challenges, this study adopts a novel contrastive approach by focusing on emotion-specific articulatory gestures as the core elements for analysis. By shifting the emphasis on the more stable and consistent articulatory gestures, we aim to enhance emotion transfer learning in SER tasks. Our research leverages the CREMA-D and MSP-IMPROV corpora as benchmarks and it reveals valuable insights into the commonality and reliability of these articulatory gestures. The findings highlight mouth articulatory gesture potential as a better constraint for improving emotion recognition across different settings or domains. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_19909 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Mouth Articulation-Based Anchoring for Improved Cross-Corpus Speech Emotion Recognition Upadhyay, Shreya G. Salman, Ali N. Busso, Carlos Lee, Chi-Chun Sound Machine Learning Audio and Speech Processing Cross-corpus speech emotion recognition (SER) plays a vital role in numerous practical applications. Traditional approaches to cross-corpus emotion transfer often concentrate on adapting acoustic features to align with different corpora, domains, or labels. However, acoustic features are inherently variable and error-prone due to factors like speaker differences, domain shifts, and recording conditions. To address these challenges, this study adopts a novel contrastive approach by focusing on emotion-specific articulatory gestures as the core elements for analysis. By shifting the emphasis on the more stable and consistent articulatory gestures, we aim to enhance emotion transfer learning in SER tasks. Our research leverages the CREMA-D and MSP-IMPROV corpora as benchmarks and it reveals valuable insights into the commonality and reliability of these articulatory gestures. The findings highlight mouth articulatory gesture potential as a better constraint for improving emotion recognition across different settings or domains. |
| title | Mouth Articulation-Based Anchoring for Improved Cross-Corpus Speech Emotion Recognition |
| topic | Sound Machine Learning Audio and Speech Processing |
| url | https://arxiv.org/abs/2412.19909 |