A Baseline Multimodal Approach to Emotion Recognition in Conversations

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yeste, Víctor, Rivas-Arévalo, Rodrigo
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912866695643136
author Yeste, Víctor
Rivas-Arévalo, Rodrigo
author_facet Yeste, Víctor
Rivas-Arévalo, Rodrigo
contents We present a lightweight multimodal baseline for emotion recognition in conversations using the SemEval-2024 Task 3 dataset built from the sitcom Friends. The goal of this report is not to propose a novel state-of-the-art method, but to document an accessible reference implementation that combines (i) a transformer-based text classifier and (ii) a self-supervised speech representation model, with a simple late-fusion ensemble. We report the baseline setup and empirical results obtained under a limited training protocol, highlighting when multimodal fusion improves over unimodal models. This preprint is provided for transparency and to support future, more rigorous comparisons.
format Preprint
id arxiv_https___arxiv_org_abs_2602_00914
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle A Baseline Multimodal Approach to Emotion Recognition in Conversations
Yeste, Víctor
Rivas-Arévalo, Rodrigo
Computation and Language
Artificial Intelligence
Computers and Society
Sound
Audio and Speech Processing
I.2.7; I.2.6; J.4
We present a lightweight multimodal baseline for emotion recognition in conversations using the SemEval-2024 Task 3 dataset built from the sitcom Friends. The goal of this report is not to propose a novel state-of-the-art method, but to document an accessible reference implementation that combines (i) a transformer-based text classifier and (ii) a self-supervised speech representation model, with a simple late-fusion ensemble. We report the baseline setup and empirical results obtained under a limited training protocol, highlighting when multimodal fusion improves over unimodal models. This preprint is provided for transparency and to support future, more rigorous comparisons.
title A Baseline Multimodal Approach to Emotion Recognition in Conversations
topic Computation and Language
Artificial Intelligence
Computers and Society
Sound
Audio and Speech Processing
I.2.7; I.2.6; J.4
url https://arxiv.org/abs/2602.00914