Cover Image

ARTICLE: Annotator Reliability Through In-Context Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Dutta, Sujan, Pandita, Deepak, Weerasooriya, Tharindu Cyril, Zampieri, Marcos, Homan, Christopher M., KhudaBukhsh, Ashiqur R.
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Vicarious Offense and Noise Audit of Offensive Speech Classifiers: Unifying Human and Machine Disagreement on What is Offensive
by: Weerasooriya, Tharindu Cyril, et al.
Published: (2023)

Rater Cohesion and Quality from a Vicarious Perspective
by: Pandita, Deepak, et al.
Published: (2024)

Hope vs. Hate: Understanding User Interactions with LGBTQ+ News Content in Mainstream US News Media through the Lens of Hope Speech
by: Pofcher, Jonathan, et al.
Published: (2025)

Down the Toxicity Rabbit Hole: A Novel Framework to Bias Audit Large Language Models
by: Dutta, Arka, et al.
Published: (2023)

LPI-RIT at LeWiDi-2025: Improving Distributional Predictions via Metadata and Loss Reweighting with DisCo
by: Sawkar, Mandira, et al.
Published: (2025)

Learning Who Disagrees: Demographic Importance Weighting for Modeling Annotator Distributions with DiADEM
by: Shetty, Samay U., et al.
Published: (2026)

Gender Representation and Bias in Indian Civil Service Mock Interviews
by: Banerjee, Somonnoy, et al.
Published: (2024)

Investigating Vaccine Buyer's Remorse: Post-Vaccination Decision Regret in COVID-19 Social Media Using Politically Diverse Human Annotation
by: Stanley, Miles, et al.
Published: (2026)

ProRefine: Inference-Time Prompt Refinement with Textual Feedback
by: Pandita, Deepak, et al.
Published: (2025)

Infrastructure Ombudsman: Mining Future Failure Concerns from Structural Disaster Response
by: Chowdhury, Md Towhidul Absar, et al.
Published: (2024)

Navigating the Rabbit Hole: Emergent Biases in LLM-Generated Attack Narratives Targeting Mental Health Groups
by: Magu, Rijul, et al.
Published: (2025)

What About the Scene with the Hitler Reference? HAUNT: A Framework to Probe LLMs' Self-consistency Via Adversarial Nudge
by: Dutta, Arka, et al.
Published: (2025)

Subasa - Adapting Language Models for Low-resourced Offensive Language Detection in Sinhala
by: Haturusinghe, Shanilka, et al.
Published: (2025)

Community Needs and Assets: A Computational Analysis of Community Conversations
by: Chowdhury, Md Towhidul Absar, et al.
Published: (2024)

On the State of NLP Approaches to Modeling Depression in Social Media: A Post-COVID-19 Outlook
by: Bucur, Ana-Maria, et al.
Published: (2024)

Datasets for Depression Modeling in Social Media: An Overview
by: Bucur, Ana-Maria, et al.
Published: (2025)

A Federated Learning Approach to Privacy Preserving Offensive Language Identification
by: Zampieri, Marcos, et al.
Published: (2024)

Forest vs Tree: The $(N, K)$ Trade-off in Reproducible ML Evaluation
by: Pandita, Deepak, et al.
Published: (2025)

How Many Ratings per Item are Necessary for Reliable Significance Testing?
by: Homan, Christopher, et al.
Published: (2024)

Improving Reproducibility in Evaluation through Multi-Level Annotator Modeling
by: Pandita, Deepak, et al.
Published: (2026)

When Neutral Summaries are not that Neutral: Quantifying Political Neutrality in LLM-Generated News Summaries
by: Vijay, Supriti, et al.
Published: (2024)

Grammatical Error Correction for Low-Resource Languages: The Case of Zarma
by: Keita, Mamadou K., et al.
Published: (2024)

Kernel-based estimators for functional causal effects
by: Raykov, Yordan P., et al.
Published: (2025)

Statistical inference for a multiscale stochastic model of enzyme kinetics via propagation of chaos
by: Ganguly, Arnab, et al.
Published: (2024)

Asymptotic Analysis of the Total Quasi-Steady State Approximation for the Michaelis--Menten Enzyme Kinetic Reactions
by: Ganguly, Arnab, et al.
Published: (2025)

Local times of self-intersection and sample path properties of Volterra Gaussian processes
by: Izyumtseva, Olga, et al.
Published: (2024)

Mixing time for an epidemic model on graphs with external sources of infection
by: KhudaBukhsh, Wasiur R., et al.
Published: (2025)

Self-intersection local times for Volterra Gaussian processes in stochastic flows with interaction
by: Izyumtseva, Olga, et al.
Published: (2026)

Health Text Simplification: An Annotated Corpus for Digestive Cancer Education and Novel Strategies for Reinforcement Learning
by: Rahman, Md Mushfiqur, et al.
Published: (2024)

SOLD: Sinhala Offensive Language Dataset
by: Ranasinghe, Tharindu, et al.
Published: (2022)

Exploring Imbalanced Annotations for Effective In-Context Learning
by: Gao, Hongfu, et al.
Published: (2025)

R2T: Rule-Encoded Loss Functions for Low-Resource Sequence Tagging
by: Keita, Mamadou K., et al.
Published: (2025)

Efficient Annotator Reliability Assessment with EffiARA
by: Cook, Owen, et al.
Published: (2025)

Evaluating Open-Source Vision-Language Models for Multimodal Sarcasm Detection
by: Basnet, Saroj, et al.
Published: (2025)

ALEXSIS-PT: A New Resource for Portuguese Lexical Simplification
by: North, Kai, et al.
Published: (2022)

Guided Distant Supervision for Multilingual Relation Extraction Data: Adapting to a New Language
by: Plum, Alistair, et al.
Published: (2024)

RadAnnotate: Large Language Models for Efficient and Reliable Radiology Report Annotation
by: Shetty, Saisha Pradeep, et al.
Published: (2026)

Model-based clustering of time-dependent observations with common structural changes
by: Corradin, Riccardo, et al.
Published: (2024)

Stochastic Analysis of Entanglement-assisted Quantum Communication Channels
by: Elsayed, Karim S., et al.
Published: (2024)

Pairwise accelerated failure time regression models for infectious disease transmission in close-contact groups with external sources of infection
by: Sharker, Yushuf, et al.
Published: (2019)