SocialPET: Socially Informed Pattern Exploiting Training for Few-Shot Stance Detection in Social Media

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Khiabani, Parisa Jamadi, Zubiaga, Arkaitz
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910358411673600
author Khiabani, Parisa Jamadi
Zubiaga, Arkaitz
author_facet Khiabani, Parisa Jamadi
Zubiaga, Arkaitz
contents Stance detection, as the task of determining the viewpoint of a social media post towards a target as 'favor' or 'against', has been understudied in the challenging yet realistic scenario where there is limited labeled data for a certain target. Our work advances research in few-shot stance detection by introducing SocialPET, a socially informed approach to leveraging language models for the task. Our proposed approach builds on the Pattern Exploiting Training (PET) technique, which addresses classification tasks as cloze questions through the use of language models. To enhance the approach with social awareness, we exploit the social network structure surrounding social media posts. We prove the effectiveness of SocialPET on two stance datasets, Multi-target and P-Stance, outperforming competitive stance detection models as well as the base model, PET, where the labeled instances for the target under study is as few as 100. When we delve into the results, we observe that SocialPET is comparatively strong in identifying instances of the `against' class, where baseline models underperform.
format Preprint
id arxiv_https___arxiv_org_abs_2403_05216
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle SocialPET: Socially Informed Pattern Exploiting Training for Few-Shot Stance Detection in Social Media
Khiabani, Parisa Jamadi
Zubiaga, Arkaitz
Computation and Language
Social and Information Networks
Stance detection, as the task of determining the viewpoint of a social media post towards a target as 'favor' or 'against', has been understudied in the challenging yet realistic scenario where there is limited labeled data for a certain target. Our work advances research in few-shot stance detection by introducing SocialPET, a socially informed approach to leveraging language models for the task. Our proposed approach builds on the Pattern Exploiting Training (PET) technique, which addresses classification tasks as cloze questions through the use of language models. To enhance the approach with social awareness, we exploit the social network structure surrounding social media posts. We prove the effectiveness of SocialPET on two stance datasets, Multi-target and P-Stance, outperforming competitive stance detection models as well as the base model, PET, where the labeled instances for the target under study is as few as 100. When we delve into the results, we observe that SocialPET is comparatively strong in identifying instances of the `against' class, where baseline models underperform.
title SocialPET: Socially Informed Pattern Exploiting Training for Few-Shot Stance Detection in Social Media
topic Computation and Language
Social and Information Networks
url https://arxiv.org/abs/2403.05216