Copertina

A Decomposition-Based Approach for Evaluating and Analyzing Inter-Annotator Disagreement

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Levi, Effi, Shenhav, Shaul R.
Natura:	Preprint
Pubblicazione:	2022
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Dialogues of Dissent: Thematic and Rhetorical Dimensions of Hate and Counter-Hate Speech in Social Media Conversations
di: Levi, Effi, et al.
Pubblicazione: (2025)

Reap the Wild Wind: Detecting Media Storms in Large-Scale News Corpora
di: Markus, Dror K., et al.
Pubblicazione: (2024)

IsraParlTweet: The Israeli Parliamentary and Twitter Resource
di: Mor-Lan, Guy, et al.
Pubblicazione: (2024)

You're Not Gonna Believe This: A Computational Analysis of Factual Appeals and Sourcing in Partisan News
di: Mor-Lan, Guy, et al.
Pubblicazione: (2025)

Exploring Factual Entailment with NLI: A News Media Study
di: Mor-Lan, Guy, et al.
Pubblicazione: (2024)

FactAppeal: Identifying Epistemic Factual Appeals in News Media
di: Mor-Lan, Guy, et al.
Pubblicazione: (2025)

HebID: Detecting Social Identities in Hebrew-language Political Text
di: Mor-Lan, Guy, et al.
Pubblicazione: (2025)

Beyond Consensus: Perspectivist Modeling and Evaluation of Annotator Disagreement in NLP
di: Xu, Yinuo, et al.
Pubblicazione: (2026)

Leveraging Annotator Disagreement for Text Classification
di: Xu, Jin, et al.
Pubblicazione: (2024)

NUTMEG: Separating Signal From Noise in Annotator Disagreement
di: Ivey, Jonathan, et al.
Pubblicazione: (2025)

Modeling Annotator Disagreement with Demographic-Aware Experts and Synthetic Perspectives
di: Xu, Yinuo, et al.
Pubblicazione: (2025)

Crowd-Calibrator: Can Annotator Disagreement Inform Calibration in Subjective Tasks?
di: Khurana, Urja, et al.
Pubblicazione: (2024)

Listen to the Layers: Mitigating Hallucinations with Inter-Layer Disagreement
di: Subbalakshmi, Koduvayur, et al.
Pubblicazione: (2026)

When the Majority is Wrong: Modeling Annotator Disagreement for Subjective Tasks
di: Fleisig, Eve, et al.
Pubblicazione: (2023)

Structured Disagreement in Health-Literacy Annotation: Epistemic Stability, Conceptual Difficulty, and Agreement-Stratified Inference
di: Kellert, Olga, et al.
Pubblicazione: (2026)

JuniperLiu at CoMeDi Shared Task: Models as Annotators in Lexical Semantics Disagreements
di: Liu, Zhu, et al.
Pubblicazione: (2024)

Can Reasoning Help Large Language Models Capture Human Annotator Disagreement?
di: Ni, Jingwei, et al.
Pubblicazione: (2025)

Counting on Consensus: Selecting the Right Inter-annotator Agreement Metric for NLP Annotation and Evaluation
di: James, Joseph
Pubblicazione: (2026)

Decoding Climate Disagreement: A Graph Neural Network-Based Approach to Understanding Social Media Dynamics
di: Su, Ruiran, et al.
Pubblicazione: (2024)

Dealing with Annotator Disagreement in Hate Speech Classification
di: Dehghan, Somaiyeh, et al.
Pubblicazione: (2025)

Funzac at CoMeDi Shared Task: Modeling Annotator Disagreement from Word-In-Context Perspectives
di: Sarumi, Olufunke O., et al.
Pubblicazione: (2025)

Is LLM an Overconfident Judge? Unveiling the Capabilities of LLMs in Detecting Offensive Language with Annotation Disagreement
di: Lu, Junyu, et al.
Pubblicazione: (2025)

Enhancing LLM-Based Data Annotation with Error Decomposition
di: Xu, Zhen, et al.
Pubblicazione: (2026)

Analyzing Dataset Annotation Quality Management in the Wild
di: Klie, Jan-Christoph, et al.
Pubblicazione: (2023)

Who and What? Using Linguistic Features and Annotator Characteristics to Analyze Annotation Variation
di: Maurer, Maximilian, et al.
Pubblicazione: (2026)

When Disagreements Elicit Robustness: Investigating Self-Repair Capabilities under LLM Multi-Agent Disagreements
di: Ju, Tianjie, et al.
Pubblicazione: (2025)

The Media Bias Detector: A Framework for Annotating and Analyzing the News at Scale
di: Haider, Samar, et al.
Pubblicazione: (2025)

Aggregate vs. Personalized Judges in Business Idea Evaluation: Evidence from Expert Disagreement
di: Hirota, Wataru, et al.
Pubblicazione: (2026)

D3CODE: Disentangling Disagreements in Data across Cultures on Offensiveness Detection and Evaluation
di: Davani, Aida Mostafazadeh, et al.
Pubblicazione: (2024)

Error Span Annotation: A Balanced Approach for Human Evaluation of Machine Translation
di: Kocmi, Tom, et al.
Pubblicazione: (2024)

Quantifying and Predicting Disagreement in Graded Human Ratings
di: Zhang, Leixin, et al.
Pubblicazione: (2026)

Understanding and Analyzing Inappropriately Targeting Language in Online Discourse: A Comparative Annotation Study
di: Barbarestani, Baran, et al.
Pubblicazione: (2025)

A Dataset for Physical and Abstract Plausibility and Sources of Human Disagreement
di: Eichel, Annerose, et al.
Pubblicazione: (2024)

Aligning LLM Uncertainty with Human Disagreement in Subjectivity Analysis
di: Lu, Junyu, et al.
Pubblicazione: (2026)

Do Differences in Values Influence Disagreements in Online Discussions?
di: van der Meer, Michiel, et al.
Pubblicazione: (2023)

Bridging the Gap: In-Context Learning for Modeling Human Disagreement
di: Muscato, Benedetta, et al.
Pubblicazione: (2025)

From Disagreement to Understanding: The Case for Ambiguity Detection in NLI
di: Jayaweera, Chathuri, et al.
Pubblicazione: (2025)

Med-CoDE: Medical Critique based Disagreement Evaluation Framework
di: Gupta, Mohit, et al.
Pubblicazione: (2025)

An LLM Agent-Based Complex Semantic Table Annotation Approach
di: Geng, Yilin, et al.
Pubblicazione: (2025)

Disagreement as Data: Reasoning Trace Analytics in Multi-Agent Systems
di: Tajik, Elham, et al.
Pubblicazione: (2026)