Saved in:
Bibliographic Details
Main Authors: Ferreira-Saraiva, Bruno D., Pirola, Zuil, Matos-Carvalho, João P., Marques-Pita, Manuel
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2409.05530
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912019056164864
author Ferreira-Saraiva, Bruno D.
Pirola, Zuil
Matos-Carvalho, João P.
Marques-Pita, Manuel
author_facet Ferreira-Saraiva, Bruno D.
Pirola, Zuil
Matos-Carvalho, João P.
Marques-Pita, Manuel
contents Recent developments in online communication and their usage in everyday life have caused an explosion in the amount of a new genre of text data, short text. Thus, the need to classify this type of text based on its content has a significant implication in many areas. Online debates are no exception, once these provide access to information about opinions, positions and preferences of its users. This paper aims to use data obtained from online social conversations in Portuguese schools (short text) to observe behavioural trends and to see if students remain engaged in the discussion when stimulated. This project used the state of the art (SoA) Machine Learning (ML) algorithms and methods, through BERT based models to classify if utterances are in or out of the debate subject. Using SBERT embeddings as a feature, with supervised learning, the proposed model achieved results above 0.95 average accuracy for classifying online messages. Such improvements can help social scientists better understand human communication, behaviour, discussion and persuasion.
format Preprint
id arxiv_https___arxiv_org_abs_2409_05530
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle QiBERT -- Classifying Online Conversations Messages with BERT as a Feature
Ferreira-Saraiva, Bruno D.
Pirola, Zuil
Matos-Carvalho, João P.
Marques-Pita, Manuel
Computation and Language
Recent developments in online communication and their usage in everyday life have caused an explosion in the amount of a new genre of text data, short text. Thus, the need to classify this type of text based on its content has a significant implication in many areas. Online debates are no exception, once these provide access to information about opinions, positions and preferences of its users. This paper aims to use data obtained from online social conversations in Portuguese schools (short text) to observe behavioural trends and to see if students remain engaged in the discussion when stimulated. This project used the state of the art (SoA) Machine Learning (ML) algorithms and methods, through BERT based models to classify if utterances are in or out of the debate subject. Using SBERT embeddings as a feature, with supervised learning, the proposed model achieved results above 0.95 average accuracy for classifying online messages. Such improvements can help social scientists better understand human communication, behaviour, discussion and persuasion.
title QiBERT -- Classifying Online Conversations Messages with BERT as a Feature
topic Computation and Language
url https://arxiv.org/abs/2409.05530