Imagen de Portada

CoAnnotating: Uncertainty-Guided Work Allocation between Human and Large Language Models for Data Annotation

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Li, Minzhi, Shi, Taiwei, Ziems, Caleb, Kan, Min-Yen, Chen, Nancy F., Liu, Zhengyuan, Yang, Diyi
Formato:	Preprint
Publicado:	2023
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Social Intelligence Data Infrastructure: Structuring the Present and Navigating the Future
por: Li, Minzhi, et al.
Publicado: (2024)

DnA-Eval: Enhancing Large Language Model Evaluation through Decomposition and Aggregation
por: Li, Minzhi, et al.
Publicado: (2024)

Social Skill Training with Large Language Models
por: Yang, Diyi, et al.
Publicado: (2024)

Can Large Language Models Transform Computational Social Science?
por: Ziems, Caleb, et al.
Publicado: (2023)

Measuring and Addressing Indexical Bias in Information Retrieval
por: Ziems, Caleb, et al.
Publicado: (2024)

Exploring Multi-Grained Concept Annotations for Multimodal Large Language Models
por: Xu, Xiao, et al.
Publicado: (2024)

Aligning Large Language Models with Human Opinions through Persona Selection and Value--Belief--Norm Reasoning
por: Long, Do Xuan, et al.
Publicado: (2023)

Culture Cartography: Mapping the Landscape of Cultural Knowledge
por: Ziems, Caleb, et al.
Publicado: (2025)

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators
por: Gu, Feng, et al.
Publicado: (2025)

Selective Annotation via Data Allocation: These Data Should Be Triaged to Experts for Annotation Rather Than the Model
por: Huang, Chen, et al.
Publicado: (2024)

CultureBank: An Online Community-Driven Knowledge Base Towards Culturally Aware Language Technologies
por: Shi, Weiyan, et al.
Publicado: (2024)

Evaluating Large Language Models as Expert Annotators
por: Tseng, Yu-Min, et al.
Publicado: (2025)

Who Annotates in NLP? A Large-scale Assessment of Human Annotation Reporting between 2018 and 2025
por: Kunilovskaya, Maria, et al.
Publicado: (2026)

Safer-Instruct: Aligning Language Models with Automated Preference Data
por: Shi, Taiwei, et al.
Publicado: (2023)

ReasonScaffold: A Scaffolded Reasoning-based Annotation Protocol for Human-AI Co-Annotation
por: Sudheendra, Smitha Muthya, et al.
Publicado: (2026)

Silent Signals, Loud Impact: LLMs for Word-Sense Disambiguation of Coded Dog Whistles
por: Kruk, Julia, et al.
Publicado: (2024)

Large Language Models for Data Annotation and Synthesis: A Survey
por: Tan, Zhen, et al.
Publicado: (2024)

STEER-BENCH: A Benchmark for Evaluating the Steerability of Large Language Models
por: Chen, Kai, et al.
Publicado: (2025)

Multi-expert Prompting Improves Reliability, Safety, and Usefulness of Large Language Models
por: Long, Do Xuan, et al.
Publicado: (2024)

Human-Annotated NER Dataset for the Kyrgyz Language
por: Turatali, Timur, et al.
Publicado: (2025)

Large Language Models as Automatic Annotators and Annotation Adjudicators for Fine-Grained Opinion Analysis
por: Negi, Gaurav, et al.
Publicado: (2026)

Guiding Large Language Models to Post-Edit Machine Translation with Error Annotations
por: Ki, Dayeon, et al.
Publicado: (2024)

Measuring Large Language Models Capacity to Annotate Journalistic Sourcing
por: Vincent, Subramaniam, et al.
Publicado: (2024)

To Err Is Human; To Annotate, SILICON? Toward Robust Reproducibility in LLM Annotation
por: Cheng, Xiang, et al.
Publicado: (2024)

RadAnnotate: Large Language Models for Efficient and Reliable Radiology Report Annotation
por: Shetty, Saisha Pradeep, et al.
Publicado: (2026)

Can Reasoning Help Large Language Models Capture Human Annotator Disagreement?
por: Ni, Jingwei, et al.
Publicado: (2025)

Large Language Models as Financial Data Annotators: A Study on Effectiveness and Efficiency
por: Aguda, Toyin, et al.
Publicado: (2024)

EgoNormia: Benchmarking Physical Social Norm Understanding
por: Rezaei, MohammadHossein, et al.
Publicado: (2025)

Hybrid Annotation for Propaganda Detection: Integrating LLM Pre-Annotations with Human Intelligence
por: Sahitaj, Ariana, et al.
Publicado: (2025)

Resilience of Large Language Models for Noisy Instructions
por: Wang, Bin, et al.
Publicado: (2024)

Large Language Model Selection with Limited Annotations
por: Durmazkeser, Yavuz, et al.
Publicado: (2026)

LLMs as Data Annotators: How Close Are We to Human Performance
por: Haq, Muhammad Uzair Ul, et al.
Publicado: (2025)

Augmenting Human-Annotated Training Data with Large Language Model Generation and Distillation in Open-Response Assessment
por: Borchers, Conrad, et al.
Publicado: (2025)

Best Practices for Text Annotation with Large Language Models
por: Törnberg, Petter
Publicado: (2024)

Rethinking Emotion Annotations in the Era of Large Language Models
por: Niu, Minxue, et al.
Publicado: (2024)

Dynamic Skill Adaptation for Large Language Models
por: Chen, Jiaao, et al.
Publicado: (2024)

IDEAlign: Comparing Large Language Models to Human Experts in Open-ended Interpretive Annotations
por: Nam, Hyunji, et al.
Publicado: (2025)

How Susceptible are Large Language Models to Ideological Manipulation?
por: Chen, Kai, et al.
Publicado: (2024)

Are Expert-Level Language Models Expert-Level Annotators?
por: Tseng, Yu-Min, et al.
Publicado: (2024)

Evaluating Webcam-based Gaze Data as an Alternative for Human Rationale Annotations
por: Brandl, Stephanie, et al.
Publicado: (2024)