Cover Image

Annotation Quality in Aspect-Based Sentiment Analysis: A Case Study Comparing Experts, Students, Crowdworkers, and Large Language Model

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Donhauser, Niklas, Fehle, Jakob, Hellwig, Nils Constantin, Weinberger, Markus, Kruschwitz, Udo, Wolff, Christian
Format:	Preprint
Published:	2026
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Prompting Is All You Need: Multi-view Prompting Large Language Models for Aspect-Based Sentiment Analysis
by: Hellwig, Nils Constantin, et al.
Published: (2026)

Do we still need Human Annotators? Prompting Large Language Models for Aspect Sentiment Quad Prediction
by: Hellwig, Nils Constantin, et al.
Published: (2025)

LLM-as-an-Annotator: Training Lightweight Models with LLM-Annotated Examples for Aspect Sentiment Tuple Prediction
by: Hellwig, Nils Constantin, et al.
Published: (2026)

AnnoABSA: A Web-Based Annotation Tool for Aspect-Based Sentiment Analysis with Retrieval-Augmented Suggestions
by: Hellwig, Nils Constantin, et al.
Published: (2026)

nchellwig at SemEval-2026 Task 3: Self-Consistent Structured Generation (SCSG) for Dimensional Aspect-Based Sentiment Analysis using Large Language Models
by: Hellwig, Nils Constantin, et al.
Published: (2026)

Zero-Shot to Full-Resource: Cross-lingual Transfer Strategies for Aspect-Based Sentiment Analysis
by: Fehle, Jakob, et al.
Published: (2026)

GERestaurant: A German Dataset of Annotated Restaurant Reviews for Aspect-Based Sentiment Analysis
by: Hellwig, Nils Constantin, et al.
Published: (2024)

Investigating Neural Machine Translation for Low-Resource Languages: Using Bavarian as a Case Study
by: Her, Wan-Hua, et al.
Published: (2024)

A Reproducibility Study of Graph-Based Legal Case Retrieval
by: Donabauer, Gregor, et al.
Published: (2025)

Detecting Calls to Action in Multimodal Content: Analysis of the 2021 German Federal Election Campaign on Instagram
by: Achmann-Denkler, Michael, et al.
Published: (2024)

Can Language Models Critique Themselves? Investigating Self-Feedback for Retrieval Augmented Generation at BioASQ 2025
by: Ateia, Samy, et al.
Published: (2025)

Can Open-Source LLMs Compete with Commercial Models? Exploring the Few-Shot Performance of Current GPT Models in Biomedical Tasks
by: Ateia, Samy, et al.
Published: (2024)

Token-Level Graphs for Short Text Classification
by: Donabauer, Gregor, et al.
Published: (2024)

BioRAGent: A Retrieval-Augmented Generation System for Showcasing Generative Query Expansion and Domain-Specific Search for Scientific Q&A
by: Ateia, Samy, et al.
Published: (2024)

Challenges in Pre-Training Graph Neural Networks for Context-Based Fake News Detection: An Evaluation of Current Strategies and Resource Limitations
by: Donabauer, Gregor, et al.
Published: (2024)

From Annotation to Adaptation: Metrics, Synthetic Data, and Aspect Extraction for Aspect-Based Sentiment Analysis with Large Language Models
by: Neveditsin, Nikita, et al.
Published: (2025)

"Can You Tell Me?": Designing Copilots to Support Human Judgement in Online Information Seeking
by: Bink, Markus, et al.
Published: (2026)

Seek and You Shall Find: Design & Evaluation of a Context-Aware Interactive Search Companion
by: Bink, Markus, et al.
Published: (2026)

MetaHarm: Harmful YouTube Video Dataset Annotated by Domain Experts, GPT-4-Turbo, and Crowdworkers
by: Jo, Wonjeong, et al.
Published: (2025)

Large Language Models for Czech Aspect-Based Sentiment Analysis
by: Šmíd, Jakub, et al.
Published: (2025)

Crowdwork als Beruf?
Published: (2026)

Aspect-Based Sentiment Analysis Techniques: A Comparative Study
by: Jayakody, Dineth, et al.
Published: (2024)

Boosting Large Language Models with Continual Learning for Aspect-based Sentiment Analysis
by: Ding, Xuanwen, et al.
Published: (2024)

A Comprehensive Evaluation of Large Language Models on Aspect-Based Sentiment Analysis
by: Zhou, Changzhi, et al.
Published: (2024)

A Retail-Corpus for Aspect-Based Sentiment Analysis with Large Language Models
by: Silcenco, Oleg, et al.
Published: (2025)

Iterative Data Generation with Large Language Models for Aspect-based Sentiment Analysis
by: Zhong, Qihuang, et al.
Published: (2024)

Elektrische Klangmaschinen
by: Donhauser, Peter
Published: (2013)

Ressourcenorientierte Auftragsregelung in einer hybriden Produktion mittels betriebsbegleitender Simulation
by: Donhauser, Toni
Published: (2025)

Evaluating Zero-Shot Multilingual Aspect-Based Sentiment Analysis with Large Language Models
by: Wu, Chengyan, et al.
Published: (2024)

Explainable Multimodal Aspect-Based Sentiment Analysis with Dependency-guided Large Language Model
by: Wang, Zhongzheng, et al.
Published: (2026)

Exploring Crowdworkers' Perceptions, Current Practices, and Desired Practices Regarding Using Non-Workstation Devices for Crowdwork
by: Dutta, Senjuti, et al.
Published: (2024)

The AI Interface: Designing for the Ideal Machine-Human Experience (Editorial)
by: Sundar, Aparna, et al.
Published: (2024)

OATS: Opinion Aspect Target Sentiment Quadruple Extraction Dataset for Aspect-Based Sentiment Analysis
by: Chebolu, Siva Uday Sampreeth, et al.
Published: (2023)

Utilizing Large Language Models for Event Deconstruction to Enhance Multimodal Aspect-Based Sentiment Analysis
by: Huang, Xiaoyong, et al.
Published: (2024)

Enhancing Aspect-based Sentiment Analysis in Tourism Using Large Language Models and Positional Information
by: Xu, Chun, et al.
Published: (2024)

Large Language Models Enhanced by Plug and Play Syntactic Knowledge for Aspect-based Sentiment Analysis
by: Tian, Yuanhe, et al.
Published: (2025)

Crowdwork for young people: risks and opportunities
by: Niall O'Higgins, et al.
Published: (2022)

The Romanian Sentiment of Being
by: Noica, Constantin
Published: (2022)

Large-Scale Aspect-Based Sentiment Analysis with Reasoning-Infused LLMs
by: Liskowski, Paweł, et al.
Published: (2026)

IDEAlign: Comparing Large Language Models to Human Experts in Open-ended Interpretive Annotations
by: Nam, Hyunji, et al.
Published: (2025)