Saved in:
Bibliographic Details
Main Authors: Creanga, Claudiu, Dinu, Liviu P.
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2405.11222
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914802035589120
author Creanga, Claudiu
Dinu, Liviu P.
author_facet Creanga, Claudiu
Dinu, Liviu P.
contents This paper outlines the approach of the ISDS-NLP team in the SemEval 2024 Task 10: Emotion Discovery and Reasoning its Flip in Conversation (EDiReF). For Subtask 1 we obtained a weighted F1 score of 0.43 and placed 12 in the leaderboard. We investigate two distinct approaches: Masked Language Modeling (MLM) and Causal Language Modeling (CLM). For MLM, we employ pre-trained BERT-like models in a multilingual setting, fine-tuning them with a classifier to predict emotions. Experiments with varying input lengths, classifier architectures, and fine-tuning strategies demonstrate the effectiveness of this approach. Additionally, we utilize Mistral 7B Instruct V0.2, a state-of-the-art model, applying zero-shot and few-shot prompting techniques. Our findings indicate that while Mistral shows promise, MLMs currently outperform them in sentence-level emotion classification.
format Preprint
id arxiv_https___arxiv_org_abs_2405_11222
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Transformer based neural networks for emotion recognition in conversations
Creanga, Claudiu
Dinu, Liviu P.
Computation and Language
This paper outlines the approach of the ISDS-NLP team in the SemEval 2024 Task 10: Emotion Discovery and Reasoning its Flip in Conversation (EDiReF). For Subtask 1 we obtained a weighted F1 score of 0.43 and placed 12 in the leaderboard. We investigate two distinct approaches: Masked Language Modeling (MLM) and Causal Language Modeling (CLM). For MLM, we employ pre-trained BERT-like models in a multilingual setting, fine-tuning them with a classifier to predict emotions. Experiments with varying input lengths, classifier architectures, and fine-tuning strategies demonstrate the effectiveness of this approach. Additionally, we utilize Mistral 7B Instruct V0.2, a state-of-the-art model, applying zero-shot and few-shot prompting techniques. Our findings indicate that while Mistral shows promise, MLMs currently outperform them in sentence-level emotion classification.
title Transformer based neural networks for emotion recognition in conversations
topic Computation and Language
url https://arxiv.org/abs/2405.11222