Cover Image

Hybrid Annotation for Propaganda Detection: Integrating LLM Pre-Annotations with Human Intelligence

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Sahitaj, Ariana, Sahitaj, Premtim, Solopova, Veronika, Li, Jiaao, Möller, Sebastian, Schmitt, Vera
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Fine-tuning with Hierarchical Prompting for Robust Propaganda Classification Across Annotation Schemas
by: Stähelin, Lukas, et al.
Published: (2026)

XplaiNLP at CheckThat! 2025: Multilingual Subjectivity Detection with Finetuned Transformers and Prompt-Based Inference with Large Language Models
by: Sahitaj, Ariana, et al.
Published: (2025)

Multiperspectivity as a Resource for Narrative Similarity Prediction
by: Upravitelev, Max, et al.
Published: (2026)

Retrieving Climate Change Disinformation by Narrative
by: Upravitelev, Max, et al.
Published: (2026)

From Articles to Premises: Building PrimeFacts, an Extraction Methodology and Resource for Fact-Checking Evidence
by: Sahitaj, Premtim, et al.
Published: (2026)

Uncovering Temporal Framing in the News
by: Mahmoud, Tarek, et al.
Published: (2026)

Towards Automated Fact-Checking of Real-World Claims: Exploring Task Formulation and Assessment with LLMs
by: Sahitaj, Premtim, et al.
Published: (2025)

Transparency as Architecture: Structural Compliance Gaps in EU AI Act Article 50 II
by: Schmitt, Vera, et al.
Published: (2026)

Check News in One Click: NLP-Empowered Pro-Kremlin Propaganda Detection
by: Solopova, Veronika, et al.
Published: (2024)

HQP: A Human-Annotated Dataset for Detecting Online Propaganda
by: Maarouf, Abdurahman, et al.
Published: (2023)

Can GPT-4 Identify Propaganda? Annotation and Detection of Propaganda Spans in News Articles
by: Hasanain, Maram, et al.
Published: (2024)

How desirable is alignment between LLMs and linguistically diverse human users?
by: Knoeferle, Pia, et al.
Published: (2025)

Human-LLM Hybrid Text Answer Aggregation for Crowd Annotations
by: Li, Jiyi
Published: (2024)

To Err Is Human; To Annotate, SILICON? Toward Robust Reproducibility in LLM Annotation
by: Cheng, Xiang, et al.
Published: (2024)

MultiGraSCCo: A Multilingual Anonymization Benchmark with Annotations of Personal Identifiers
by: Baroud, Ibrahim, et al.
Published: (2026)

Gendered Prompting and LLM Code Review: How Gender Cues in the Prompt Shape Code Quality and Evaluation
by: Janzen, Lynn, et al.
Published: (2026)

Refining and Reusing Annotation Guidelines for LLM Annotation
by: Kim, Kon Woo, et al.
Published: (2026)

GPT Assisted Annotation of Rhetorical and Linguistic Features for Interpretable Propaganda Technique Detection in News Text
by: Hamilton, Kyle, et al.
Published: (2024)

Large Language Models for Propaganda Span Annotation
by: Hasanain, Maram, et al.
Published: (2023)

MisinfoTeleGraph: Network-driven Misinformation Detection for German Telegram Messages
by: Kalkbrenner, Lu, et al.
Published: (2025)

MEGAnno+: A Human-LLM Collaborative Annotation System
by: Kim, Hannah, et al.
Published: (2024)

Sina at FigNews 2024: Multilingual Datasets Annotated with Bias and Propaganda
by: Duaibes, Lina, et al.
Published: (2024)

AFaCTA: Assisting the Annotation of Factual Claim Detection with Reliable LLM Annotators
by: Ni, Jingwei, et al.
Published: (2024)

Memory Is All You Need: Testing How Model Memory Affects LLM Performance in Annotation Tasks
by: Timoneda, Joan C., et al.
Published: (2025)

Online Density-Based Clustering for Real-Time Narrative Evolution Monitorin
by: Vykhopen, Ostap, et al.
Published: (2026)

Multilingual Datasets for Custom Input Extraction and Explanation Requests Parsing in Conversational XAI Systems
by: Wang, Qianli, et al.
Published: (2025)

What Are We Measuring in NLG? A Meta-Analysis of Evaluation Trends 2020-2025
by: Yang, Jing, et al.
Published: (2026)

Human and LLM Biases in Hate Speech Annotations: A Socio-Demographic Analysis of Annotators and Targets
by: Giorgi, Tommaso, et al.
Published: (2024)

From Trust to Truth: Actionable policies for the use of AI in fact-checking in Germany and Ukraine
by: Solopova, Veronika
Published: (2025)

LLM-as-an-Annotator: Training Lightweight Models with LLM-Annotated Examples for Aspect Sentiment Tuple Prediction
by: Hellwig, Nils Constantin, et al.
Published: (2026)

The Alternative Annotator Test for LLM-as-a-Judge: How to Statistically Justify Replacing Human Annotators with LLMs
by: Calderon, Nitay, et al.
Published: (2025)

It's Difficult to be Neutral -- Human and LLM-based Sentiment Annotation of Patient Comments
by: Mæhlum, Petter, et al.
Published: (2024)

On Crowdsourcing Task Design for Discourse Relation Annotation
by: Yung, Frances, et al.
Published: (2024)

Bias in LLMs as Annotators: The Effect of Party Cues on Labelling Decision by Large Language Models
by: Vera, Sebastian Vallejo, et al.
Published: (2024)

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators
by: Gu, Feng, et al.
Published: (2025)

Repurposing Annotation Guidelines to Instruct LLM Annotators: A Case Study
by: Kim, Kon Woo, et al.
Published: (2025)

CoAnnotating: Uncertainty-Guided Work Allocation between Human and Large Language Models for Data Annotation
by: Li, Minzhi, et al.
Published: (2023)

Do We Still Need Humans in the Loop? Comparing Human and LLM Annotation in Active Learning for Hostility Detection
by: Hakimi, Ahmad Dawar, et al.
Published: (2026)

Different Tastes of Entities: Investigating Human Label Variation in Named Entity Annotations
by: Peng, Siyao, et al.
Published: (2024)

ReasonScaffold: A Scaffolded Reasoning-based Annotation Protocol for Human-AI Co-Annotation
by: Sudheendra, Smitha Muthya, et al.
Published: (2026)