Hybrid Annotation for Propaganda Detection: Integrating LLM Pre-Annotations with Human Intelligence
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | Sahitaj, Ariana, Sahitaj, Premtim, Solopova, Veronika, Li, Jiaao, Möller, Sebastian, Schmitt, Vera |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
Documents similaires
Fine-tuning with Hierarchical Prompting for Robust Propaganda Classification Across Annotation Schemas
par: Stähelin, Lukas, et autres
Publié: (2026)
par: Stähelin, Lukas, et autres
Publié: (2026)
XplaiNLP at CheckThat! 2025: Multilingual Subjectivity Detection with Finetuned Transformers and Prompt-Based Inference with Large Language Models
par: Sahitaj, Ariana, et autres
Publié: (2025)
par: Sahitaj, Ariana, et autres
Publié: (2025)
Multiperspectivity as a Resource for Narrative Similarity Prediction
par: Upravitelev, Max, et autres
Publié: (2026)
par: Upravitelev, Max, et autres
Publié: (2026)
Retrieving Climate Change Disinformation by Narrative
par: Upravitelev, Max, et autres
Publié: (2026)
par: Upravitelev, Max, et autres
Publié: (2026)
From Articles to Premises: Building PrimeFacts, an Extraction Methodology and Resource for Fact-Checking Evidence
par: Sahitaj, Premtim, et autres
Publié: (2026)
par: Sahitaj, Premtim, et autres
Publié: (2026)
Uncovering Temporal Framing in the News
par: Mahmoud, Tarek, et autres
Publié: (2026)
par: Mahmoud, Tarek, et autres
Publié: (2026)
Towards Automated Fact-Checking of Real-World Claims: Exploring Task Formulation and Assessment with LLMs
par: Sahitaj, Premtim, et autres
Publié: (2025)
par: Sahitaj, Premtim, et autres
Publié: (2025)
Transparency as Architecture: Structural Compliance Gaps in EU AI Act Article 50 II
par: Schmitt, Vera, et autres
Publié: (2026)
par: Schmitt, Vera, et autres
Publié: (2026)
Check News in One Click: NLP-Empowered Pro-Kremlin Propaganda Detection
par: Solopova, Veronika, et autres
Publié: (2024)
par: Solopova, Veronika, et autres
Publié: (2024)
HQP: A Human-Annotated Dataset for Detecting Online Propaganda
par: Maarouf, Abdurahman, et autres
Publié: (2023)
par: Maarouf, Abdurahman, et autres
Publié: (2023)
Can GPT-4 Identify Propaganda? Annotation and Detection of Propaganda Spans in News Articles
par: Hasanain, Maram, et autres
Publié: (2024)
par: Hasanain, Maram, et autres
Publié: (2024)
How desirable is alignment between LLMs and linguistically diverse human users?
par: Knoeferle, Pia, et autres
Publié: (2025)
par: Knoeferle, Pia, et autres
Publié: (2025)
Human-LLM Hybrid Text Answer Aggregation for Crowd Annotations
par: Li, Jiyi
Publié: (2024)
par: Li, Jiyi
Publié: (2024)
To Err Is Human; To Annotate, SILICON? Toward Robust Reproducibility in LLM Annotation
par: Cheng, Xiang, et autres
Publié: (2024)
par: Cheng, Xiang, et autres
Publié: (2024)
MultiGraSCCo: A Multilingual Anonymization Benchmark with Annotations of Personal Identifiers
par: Baroud, Ibrahim, et autres
Publié: (2026)
par: Baroud, Ibrahim, et autres
Publié: (2026)
Gendered Prompting and LLM Code Review: How Gender Cues in the Prompt Shape Code Quality and Evaluation
par: Janzen, Lynn, et autres
Publié: (2026)
par: Janzen, Lynn, et autres
Publié: (2026)
Refining and Reusing Annotation Guidelines for LLM Annotation
par: Kim, Kon Woo, et autres
Publié: (2026)
par: Kim, Kon Woo, et autres
Publié: (2026)
GPT Assisted Annotation of Rhetorical and Linguistic Features for Interpretable Propaganda Technique Detection in News Text
par: Hamilton, Kyle, et autres
Publié: (2024)
par: Hamilton, Kyle, et autres
Publié: (2024)
Large Language Models for Propaganda Span Annotation
par: Hasanain, Maram, et autres
Publié: (2023)
par: Hasanain, Maram, et autres
Publié: (2023)
MisinfoTeleGraph: Network-driven Misinformation Detection for German Telegram Messages
par: Kalkbrenner, Lu, et autres
Publié: (2025)
par: Kalkbrenner, Lu, et autres
Publié: (2025)
MEGAnno+: A Human-LLM Collaborative Annotation System
par: Kim, Hannah, et autres
Publié: (2024)
par: Kim, Hannah, et autres
Publié: (2024)
Sina at FigNews 2024: Multilingual Datasets Annotated with Bias and Propaganda
par: Duaibes, Lina, et autres
Publié: (2024)
par: Duaibes, Lina, et autres
Publié: (2024)
AFaCTA: Assisting the Annotation of Factual Claim Detection with Reliable LLM Annotators
par: Ni, Jingwei, et autres
Publié: (2024)
par: Ni, Jingwei, et autres
Publié: (2024)
Memory Is All You Need: Testing How Model Memory Affects LLM Performance in Annotation Tasks
par: Timoneda, Joan C., et autres
Publié: (2025)
par: Timoneda, Joan C., et autres
Publié: (2025)
Online Density-Based Clustering for Real-Time Narrative Evolution Monitorin
par: Vykhopen, Ostap, et autres
Publié: (2026)
par: Vykhopen, Ostap, et autres
Publié: (2026)
Multilingual Datasets for Custom Input Extraction and Explanation Requests Parsing in Conversational XAI Systems
par: Wang, Qianli, et autres
Publié: (2025)
par: Wang, Qianli, et autres
Publié: (2025)
What Are We Measuring in NLG? A Meta-Analysis of Evaluation Trends 2020-2025
par: Yang, Jing, et autres
Publié: (2026)
par: Yang, Jing, et autres
Publié: (2026)
Human and LLM Biases in Hate Speech Annotations: A Socio-Demographic Analysis of Annotators and Targets
par: Giorgi, Tommaso, et autres
Publié: (2024)
par: Giorgi, Tommaso, et autres
Publié: (2024)
From Trust to Truth: Actionable policies for the use of AI in fact-checking in Germany and Ukraine
par: Solopova, Veronika
Publié: (2025)
par: Solopova, Veronika
Publié: (2025)
LLM-as-an-Annotator: Training Lightweight Models with LLM-Annotated Examples for Aspect Sentiment Tuple Prediction
par: Hellwig, Nils Constantin, et autres
Publié: (2026)
par: Hellwig, Nils Constantin, et autres
Publié: (2026)
The Alternative Annotator Test for LLM-as-a-Judge: How to Statistically Justify Replacing Human Annotators with LLMs
par: Calderon, Nitay, et autres
Publié: (2025)
par: Calderon, Nitay, et autres
Publié: (2025)
It's Difficult to be Neutral -- Human and LLM-based Sentiment Annotation of Patient Comments
par: Mæhlum, Petter, et autres
Publié: (2024)
par: Mæhlum, Petter, et autres
Publié: (2024)
On Crowdsourcing Task Design for Discourse Relation Annotation
par: Yung, Frances, et autres
Publié: (2024)
par: Yung, Frances, et autres
Publié: (2024)
Bias in LLMs as Annotators: The Effect of Party Cues on Labelling Decision by Large Language Models
par: Vera, Sebastian Vallejo, et autres
Publié: (2024)
par: Vera, Sebastian Vallejo, et autres
Publié: (2024)
Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators
par: Gu, Feng, et autres
Publié: (2025)
par: Gu, Feng, et autres
Publié: (2025)
Repurposing Annotation Guidelines to Instruct LLM Annotators: A Case Study
par: Kim, Kon Woo, et autres
Publié: (2025)
par: Kim, Kon Woo, et autres
Publié: (2025)
CoAnnotating: Uncertainty-Guided Work Allocation between Human and Large Language Models for Data Annotation
par: Li, Minzhi, et autres
Publié: (2023)
par: Li, Minzhi, et autres
Publié: (2023)
Do We Still Need Humans in the Loop? Comparing Human and LLM Annotation in Active Learning for Hostility Detection
par: Hakimi, Ahmad Dawar, et autres
Publié: (2026)
par: Hakimi, Ahmad Dawar, et autres
Publié: (2026)
Different Tastes of Entities: Investigating Human Label Variation in Named Entity Annotations
par: Peng, Siyao, et autres
Publié: (2024)
par: Peng, Siyao, et autres
Publié: (2024)
ReasonScaffold: A Scaffolded Reasoning-based Annotation Protocol for Human-AI Co-Annotation
par: Sudheendra, Smitha Muthya, et autres
Publié: (2026)
par: Sudheendra, Smitha Muthya, et autres
Publié: (2026)
Documents similaires
-
Fine-tuning with Hierarchical Prompting for Robust Propaganda Classification Across Annotation Schemas
par: Stähelin, Lukas, et autres
Publié: (2026) -
XplaiNLP at CheckThat! 2025: Multilingual Subjectivity Detection with Finetuned Transformers and Prompt-Based Inference with Large Language Models
par: Sahitaj, Ariana, et autres
Publié: (2025) -
Multiperspectivity as a Resource for Narrative Similarity Prediction
par: Upravitelev, Max, et autres
Publié: (2026) -
Retrieving Climate Change Disinformation by Narrative
par: Upravitelev, Max, et autres
Publié: (2026) -
From Articles to Premises: Building PrimeFacts, an Extraction Methodology and Resource for Fact-Checking Evidence
par: Sahitaj, Premtim, et autres
Publié: (2026)