Image de couverture de livre

Repurposing Annotation Guidelines to Instruct LLM Annotators: A Case Study

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Kim, Kon Woo, Islamaj, Rezarta, Kim, Jin-Dong, Boudin, Florian, Aizawa, Akiko
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Refining and Reusing Annotation Guidelines for LLM Annotation
par: Kim, Kon Woo, et autres
Publié: (2026)

Unsupervised Domain Adaptation for Keyphrase Generation using Citation Contexts
par: Boudin, Florian, et autres
Publié: (2024)

An Analysis of Datasets, Metrics and Models in Keyphrase Generation
par: Boudin, Florian, et autres
Publié: (2025)

Preface to the Special Issue of the TAL Journal on Scholarly Document Processing
par: Boudin, Florian, et autres
Publié: (2025)

Automatically Suggesting Diverse Example Sentences for L2 Japanese Learners Using Pre-Trained Language Models
par: Benedetti, Enrico, et autres
Publié: (2025)

Reassessing Extractive QA Datasets at Scale: LLM-as-a-Judge and In-Depth Analyses
par: Ho, Xanh, et autres
Publié: (2025)

Multi-News+: Cost-efficient Dataset Cleansing via LLM-based Data Annotation
par: Choi, Juhwan, et autres
Publié: (2024)

A Highly Clean Recipe Dataset with Ingredient States Annotation for State Probing Task
par: Toyooka, Mashiro, et autres
Publié: (2025)

Can Large Language Models Follow Concept Annotation Guidelines? A Case Study on Scientific and Financial Domains
par: Fonseca, Marcio, et autres
Publié: (2023)

Evaluating the Impact of LLM-Assisted Annotation in a Perspectivized Setting: the Case of FrameNet Annotation
par: Belcavello, Frederico, et autres
Publié: (2025)

What Do Biomedical NER and Entity Linking Benchmarks Measure? A Corpus-Centric Diagnostic Framework
par: Leaman, Robert, et autres
Publié: (2026)

GPTs Are Multilingual Annotators for Sequence Generation Tasks
par: Choi, Juhwan, et autres
Publié: (2024)

SelectLLM: Can LLMs Select Important Instructions to Annotate?
par: Parkar, Ritik Sachin, et autres
Publié: (2024)

Spread Preference Annotation: Direct Preference Judgment for Efficient LLM Alignment
par: Kim, Dongyoung, et autres
Publié: (2024)

Harnessing PDF Data for Improving Japanese Large Multimodal Models
par: Baek, Jeonghun, et autres
Publié: (2025)

AFaCTA: Assisting the Annotation of Factual Claim Detection with Reliable LLM Annotators
par: Ni, Jingwei, et autres
Publié: (2024)

Guidelines for the Annotation and Visualization of Legal Argumentation Structures in Chinese Judicial Decisions
par: Chen, Kun, et autres
Publié: (2026)

Condition-Gated Reasoning for Context-Dependent Biomedical Question Answering
par: Parekh, Jash Rajesh, et autres
Publié: (2026)

Self-Compositional Data Augmentation for Scientific Keyphrase Generation
par: Houbre, Mael, et autres
Publié: (2024)

Emergent Convergence in Multi-Agent LLM Annotation
par: Parfenova, Angelina, et autres
Publié: (2025)

Converting Annotated Clinical Cases into Structured Case Report Forms
par: Ferrazzi, Pietro, et autres
Publié: (2025)

Human and LLM Biases in Hate Speech Annotations: A Socio-Demographic Analysis of Annotators and Targets
par: Giorgi, Tommaso, et autres
Publié: (2024)

Enhancing LLM-Based Data Annotation with Error Decomposition
par: Xu, Zhen, et autres
Publié: (2026)

IPCGRL: Language-Instructed Reinforcement Learning for Procedural Level Generation
par: Baek, In-Chang, et autres
Publié: (2025)

Manga109-v2026: Revisiting Manga109 Annotations for Modern Manga Understanding
par: Baek, Jeonghun, et autres
Publié: (2026)

Synthesized Annotation Guidelines are Knowledge-Lite Boosters for Clinical Information Extraction
par: Hsu, Enshuo, et autres
Publié: (2025)

The Promises and Pitfalls of LLM Annotations in Dataset Labeling: a Case Study on Media Bias Detection
par: Horych, Tomas, et autres
Publié: (2024)

DiZiNER: Disagreement-guided Instruction Refinement via Pilot Annotation Simulation for Zero-shot Named Entity Recognition
par: Kim, Siun, et autres
Publié: (2026)

Towards Event Extraction with Massive Types: LLM-based Collaborative Annotation and Partitioning Extraction
par: Liu, Wenxuan, et autres
Publié: (2025)

Exploring Cross-Cultural Differences in English Hate Speech Annotations: From Dataset Construction to Analysis
par: Lee, Nayeon, et autres
Publié: (2023)

Comparing LLM Text Annotation Skills: A Study on Human Rights Violations in Social Media Data
par: Nemkova, Poli Apollinaire, et autres
Publié: (2025)

Users as Annotators: LLM Preference Learning from Comparison Mode
par: Cai, Zhongze, et autres
Publié: (2025)

Annotation Guidelines-Based Knowledge Augmentation: Towards Enhancing Large Language Models for Educational Text Classification
par: Liu, Shiqi, et autres
Publié: (2024)

How Annotation Trains Annotators: Competence Development in Social Influence Recognition
par: Markiewicz, Maciej, et autres
Publié: (2026)

Completing Missing Annotation: Multi-Agent Debate for Accurate and Scalable Relevant Assessment for IR Benchmarks
par: Ban, Minjeong, et autres
Publié: (2026)

ParaRev: Building a dataset for Scientific Paragraph Revision annotated with revision instruction
par: Jourdan, Léane, et autres
Publié: (2025)

The Alternative Annotator Test for LLM-as-a-Judge: How to Statistically Justify Replacing Human Annotators with LLMs
par: Calderon, Nitay, et autres
Publié: (2025)

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators
par: Gu, Feng, et autres
Publié: (2025)

Enhancing Annotated Bibliography Generation with LLM Ensembles
par: Bermejo, Sergio
Publié: (2024)

Med-CoDE: Medical Critique based Disagreement Evaluation Framework
par: Gupta, Mohit, et autres
Publié: (2025)