Imagen de Portada

Comparing LLM Text Annotation Skills: A Study on Human Rights Violations in Social Media Data

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Nemkova, Poli Apollinaire, Ubani, Solomon, Albert, Mark V.
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Do Large Language Models Know Conflict? Investigating Parametric vs. Non-Parametric Knowledge of LLMs for Conflict Forecasting
por: Nemkova, Apollinaire Poli, et al.
Publicado: (2025)

LIME-LLM: Probing Models with Fluent Counterfactuals, Not Broken Text
por: Mihaila, George, et al.
Publicado: (2026)

Cross-Lingual Stability and Bias in Instruction-Tuned Language Models for Humanitarian NLP
por: Nemkova, Poli, et al.
Publicado: (2025)

Whose Good, Whose Place? The Moral Geography of Agentic AI for Social Good
por: Nemkova, Poli, et al.
Publicado: (2026)

Text Annotation via Inductive Coding: Comparing Human Experts to LLMs in Qualitative Data Analysis
por: Parfenova, Angelina, et al.
Publicado: (2025)

Do We Still Need Humans in the Loop? Comparing Human and LLM Annotation in Active Learning for Hostility Detection
por: Hakimi, Ahmad Dawar, et al.
Publicado: (2026)

Routing with Generated Data: Annotation-Free LLM Skill Estimation and Expert Selection
por: Niu, Tianyi, et al.
Publicado: (2026)

Repurposing Annotation Guidelines to Instruct LLM Annotators: A Case Study
por: Kim, Kon Woo, et al.
Publicado: (2025)

MultiSocial: Multilingual Benchmark of Machine-Generated Text Detection of Social-Media Texts
por: Macko, Dominik, et al.
Publicado: (2024)

Online Social Support Detection in Spanish Social Media Texts
por: Tash, Moein Shahiki, et al.
Publicado: (2025)

LLM-guided Semi-Supervised Approaches for Social Media Crisis Data Classification
por: Ativo, Jacob, et al.
Publicado: (2026)

Enhancing LLM-Based Data Annotation with Error Decomposition
por: Xu, Zhen, et al.
Publicado: (2026)

Cross-cultural Inspiration Detection and Analysis in Real and LLM-generated Social Media Data
por: Ignat, Oana, et al.
Publicado: (2024)

A Comparative Analysis of Counterfactual Explanation Methods for Text Classifiers
por: McAleese, Stephen, et al.
Publicado: (2024)

LLM Agents Predict Social Media Reactions but Do Not Outperform Text Classifiers: Benchmarking Simulation Accuracy Using 120K+ Personas of 1511 Humans
por: Bojic, Ljubisa, et al.
Publicado: (2026)

Detecting Propaganda Techniques in Code-Switched Social Media Text
por: Salman, Muhammad Umar, et al.
Publicado: (2023)

Human and LLM Biases in Hate Speech Annotations: A Socio-Demographic Analysis of Annotators and Targets
por: Giorgi, Tommaso, et al.
Publicado: (2024)

Improving Topic Modeling of Social Media Short Texts with Rephrasing: A Case Study of COVID-19 Related Tweets
por: Xin, Wangjiaxuan, et al.
Publicado: (2025)

Comparing the Framing Effect in Humans and LLMs on Naturally Occurring Texts
por: Lior, Gili, et al.
Publicado: (2025)

Fixing It in Post: A Comparative Study of LLM Post-Training Data Quality and Model Performance
por: Djuhera, Aladin, et al.
Publicado: (2025)

From Human Annotation to Automation: LLM-in-the-Loop Active Learning for Arabic Sentiment Analysis
por: Refai, Dania, et al.
Publicado: (2025)

From Skill Text to Skill Structure: The Scheduling-Structural-Logical Representation for Agent Skills
por: Liang, Qiliang, et al.
Publicado: (2026)

Are Chatbots Reliable Text Annotators? Sometimes
por: Kristensen-McLachlan, Ross Deans, et al.
Publicado: (2023)

A Comparative Study of Decoding Strategies in Medical Text Generation
por: Presacan, Oriana, et al.
Publicado: (2025)

A Comparative Study of Quality Evaluation Methods for Text Summarization
por: Nguyen, Huyen, et al.
Publicado: (2024)

CrisisSense-LLM: Instruction Fine-Tuned Large Language Model for Multi-label Social Media Text Classification in Disaster Informatics
por: Yin, Kai, et al.
Publicado: (2024)

Evaluating LLM-Generated Versus Human-Authored Responses in Role-Play Dialogues
por: Lu, Dongxu, et al.
Publicado: (2025)

Prompt Selection Matters: Enhancing Text Annotations for Social Sciences with Large Language Models
por: Abraham, Louis, et al.
Publicado: (2024)

The Alternative Annotator Test for LLM-as-a-Judge: How to Statistically Justify Replacing Human Annotators with LLMs
por: Calderon, Nitay, et al.
Publicado: (2025)

Classifying Human-Generated and AI-Generated Election Claims in Social Media
por: Dmonte, Alphaeus, et al.
Publicado: (2024)

Grounded Misunderstandings in Asymmetric Dialogue: A Perspectivist Annotation Scheme for MapTask
por: Li, Nan, et al.
Publicado: (2025)

MultiSoc-4D: A Benchmark for Diagnosing Instruction-Induced Label Collapse in Closed-Set LLM Annotation of Bengali Social Media
por: Pramanik, Souvik, et al.
Publicado: (2026)

COMMENTATOR: A Code-mixed Multilingual Text Annotation Framework
por: Sheth, Rajvee, et al.
Publicado: (2024)

Multi-News+: Cost-efficient Dataset Cleansing via LLM-based Data Annotation
por: Choi, Juhwan, et al.
Publicado: (2024)

From Intuition to Calibrated Judgment: A Rubric-Based Expert-Panel Study of Human Detection of LLM-Generated Korean Text
por: Park, Shinwoo, et al.
Publicado: (2026)

How Annotation Trains Annotators: Competence Development in Social Influence Recognition
por: Markiewicz, Maciej, et al.
Publicado: (2026)

Sustainability via LLM Right-sizing
por: Haase, Jennifer, et al.
Publicado: (2025)

AFaCTA: Assisting the Annotation of Factual Claim Detection with Reliable LLM Annotators
por: Ni, Jingwei, et al.
Publicado: (2024)

Analyzing Gender Polarity in Short Social Media Texts with BERT: The Role of Emojis and Emoticons
por: Jazi, Saba Yousefian, et al.
Publicado: (2024)

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators
por: Gu, Feng, et al.
Publicado: (2025)