M2SA: Multimodal and Multilingual Model for Sentiment Analysis of Tweets

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Thakkar, Gaurish, Hakimov, Sherzod, Tadić, Marko
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866911913974169600
author Thakkar, Gaurish
Hakimov, Sherzod
Tadić, Marko
author_facet Thakkar, Gaurish
Hakimov, Sherzod
Tadić, Marko
contents In recent years, multimodal natural language processing, aimed at learning from diverse data types, has garnered significant attention. However, there needs to be more clarity when it comes to analysing multimodal tasks in multi-lingual contexts. While prior studies on sentiment analysis of tweets have predominantly focused on the English language, this paper addresses this gap by transforming an existing textual Twitter sentiment dataset into a multimodal format through a straightforward curation process. Our work opens up new avenues for sentiment-related research within the research community. Additionally, we conduct baseline experiments utilising this augmented dataset and report the findings. Notably, our evaluations reveal that when comparing unimodal and multimodal configurations, using a sentiment-tuned large language model as a text encoder performs exceptionally well.
format Preprint
id arxiv_https___arxiv_org_abs_2404_01753
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle M2SA: Multimodal and Multilingual Model for Sentiment Analysis of Tweets
Thakkar, Gaurish
Hakimov, Sherzod
Tadić, Marko
Computation and Language
In recent years, multimodal natural language processing, aimed at learning from diverse data types, has garnered significant attention. However, there needs to be more clarity when it comes to analysing multimodal tasks in multi-lingual contexts. While prior studies on sentiment analysis of tweets have predominantly focused on the English language, this paper addresses this gap by transforming an existing textual Twitter sentiment dataset into a multimodal format through a straightforward curation process. Our work opens up new avenues for sentiment-related research within the research community. Additionally, we conduct baseline experiments utilising this augmented dataset and report the findings. Notably, our evaluations reveal that when comparing unimodal and multimodal configurations, using a sentiment-tuned large language model as a text encoder performs exceptionally well.
title M2SA: Multimodal and Multilingual Model for Sentiment Analysis of Tweets
topic Computation and Language
url https://arxiv.org/abs/2404.01753