Language Models Learn Metadata: Political Stance Detection Case Study

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Cao, Stanley, Drinkall, Felix
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912039311507456
author Cao, Stanley
Drinkall, Felix
author_facet Cao, Stanley
Drinkall, Felix
contents Stance detection is a crucial NLP task with numerous applications in social science, from analyzing online discussions to assessing political campaigns. This paper investigates the optimal way to incorporate metadata into a political stance detection task. We demonstrate that previous methods combining metadata with language-based data for political stance detection have not fully utilized the metadata information; our simple baseline, using only party membership information, surpasses the current state-of-the-art. We then show that prepending metadata (e.g., party and policy) to political speeches performs best, outperforming all baselines, indicating that complex metadata inclusion systems may not learn the task optimally.
format Preprint
id arxiv_https___arxiv_org_abs_2409_13756
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Language Models Learn Metadata: Political Stance Detection Case Study
Cao, Stanley
Drinkall, Felix
Computation and Language
Stance detection is a crucial NLP task with numerous applications in social science, from analyzing online discussions to assessing political campaigns. This paper investigates the optimal way to incorporate metadata into a political stance detection task. We demonstrate that previous methods combining metadata with language-based data for political stance detection have not fully utilized the metadata information; our simple baseline, using only party membership information, surpasses the current state-of-the-art. We then show that prepending metadata (e.g., party and policy) to political speeches performs best, outperforming all baselines, indicating that complex metadata inclusion systems may not learn the task optimally.
title Language Models Learn Metadata: Political Stance Detection Case Study
topic Computation and Language
url https://arxiv.org/abs/2409.13756