Emotions as Ambiguity-aware Ordinal Representations

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Wu, Jingyao, Barthet, Matthew, Melhart, David, Yannakakis, Georgios N.
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912556490162176
author Wu, Jingyao
Barthet, Matthew
Melhart, David
Yannakakis, Georgios N.
author_facet Wu, Jingyao
Barthet, Matthew
Melhart, David
Yannakakis, Georgios N.
contents Emotions are inherently ambiguous and dynamic phenomena, yet existing continuous emotion recognition approaches either ignore their ambiguity or treat ambiguity as an independent and static variable over time. Motivated by this gap in the literature, in this paper we introduce ambiguity-aware ordinal emotion representations, a novel framework that captures both the ambiguity present in emotion annotation and the inherent temporal dynamics of emotional traces. Specifically, we propose approaches that model emotion ambiguity through its rate of change. We evaluate our framework on two affective corpora -- RECOLA and GameVibe -- testing our proposed approaches on both bounded (arousal, valence) and unbounded (engagement) continuous traces. Our results demonstrate that ordinal representations outperform conventional ambiguity-aware models on unbounded labels, achieving the highest Concordance Correlation Coefficient (CCC) and Signed Differential Agreement (SDA) scores, highlighting their effectiveness in modeling the traces' dynamics. For bounded traces, ordinal representations excel in SDA, revealing their superior ability to capture relative changes of annotated emotion traces.
format Preprint
id arxiv_https___arxiv_org_abs_2508_19193
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Emotions as Ambiguity-aware Ordinal Representations
Wu, Jingyao
Barthet, Matthew
Melhart, David
Yannakakis, Georgios N.
Machine Learning
Artificial Intelligence
Emotions are inherently ambiguous and dynamic phenomena, yet existing continuous emotion recognition approaches either ignore their ambiguity or treat ambiguity as an independent and static variable over time. Motivated by this gap in the literature, in this paper we introduce ambiguity-aware ordinal emotion representations, a novel framework that captures both the ambiguity present in emotion annotation and the inherent temporal dynamics of emotional traces. Specifically, we propose approaches that model emotion ambiguity through its rate of change. We evaluate our framework on two affective corpora -- RECOLA and GameVibe -- testing our proposed approaches on both bounded (arousal, valence) and unbounded (engagement) continuous traces. Our results demonstrate that ordinal representations outperform conventional ambiguity-aware models on unbounded labels, achieving the highest Concordance Correlation Coefficient (CCC) and Signed Differential Agreement (SDA) scores, highlighting their effectiveness in modeling the traces' dynamics. For bounded traces, ordinal representations excel in SDA, revealing their superior ability to capture relative changes of annotated emotion traces.
title Emotions as Ambiguity-aware Ordinal Representations
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2508.19193