Cover Image

If in a Crowdsourced Data Annotation Pipeline, a GPT-4

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	He, Zeyu, Huang, Chieh-Yang, Ding, Chien-Kuang Cornelia, Rohatgi, Shaurya, Huang, Ting-Hao 'Kenneth'
Format:	Preprint
Published:	2024
Subjects:	Human-Computer Interaction Artificial Intelligence Computation and Language Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Generating Educational Materials with Different Levels of Readability using LLMs
by: Huang, Chieh-Yang, et al.
Published: (2024)

Prompting in the Dark: Assessing Human Performance in Prompt Engineering for Data Labeling When Gold Labels Are Absent
by: He, Zeyu, et al.
Published: (2025)

What Color Scheme is More Effective in Assisting Readers to Locate Information in a Color-Coded Article?
by: Ng, Ho Yin, et al.
Published: (2024)

LLMs as Workers in Human-Computational Algorithms? Replicating Crowdsourcing Pipelines with LLMs
by: Wu, Tongshuang, et al.
Published: (2023)

Using Contextually Aligned Online Reviews to Measure LLMs' Performance Disparities Across Language Varieties
by: Tang, Zixin, et al.
Published: (2025)

How Does Conversation Length Impact User's Satisfaction? A Case Study of Length-Controlled Conversations with LLM-Powered Chatbots
by: Huang, Shih-Hong, et al.
Published: (2024)

A Comparative Study on Annotation Quality of Crowdsourcing and LLM via Label Aggregation
by: Li, Jiyi
Published: (2024)

"Newspaper Eat" Means "Not Tasty": A Taxonomy and Benchmark for Coded Language in Real-World Chinese Online Reviews
by: Wan, Ruyuan, et al.
Published: (2026)

ARAIDA: Analogical Reasoning-Augmented Interactive Data Annotation
by: Huang, Chen, et al.
Published: (2024)

Personas with Attitudes: Controlling LLMs for Diverse Data Annotation
by: Fröhling, Leon, et al.
Published: (2024)

Hey GPT, Can You be More Racist? Analysis from Crowdsourced Attempts to Elicit Biased Content from Generative AI
by: Guo, Hangzhi, et al.
Published: (2024)

Sandpiper: Orchestrated AI-Annotation for Educational Discourse at Scale
by: Hedley, Daryl, et al.
Published: (2026)

What is Stigma Attributed to? A Theory-Grounded, Expert-Annotated Interview Corpus for Demystifying Mental-Health Stigma
by: Meng, Han, et al.
Published: (2025)

Designing Computational Tools for Exploring Causal Relationships in Qualitative Data
by: Meng, Han, et al.
Published: (2026)

Efficiently Crowdsourcing Visual Importance with Punch-Hole Annotation
by: Chang, Minsuk, et al.
Published: (2024)

Crowdsourced Adaptive Surveys
by: Velez, Yamil
Published: (2024)

BP-GPT: Auditory Neural Decoding Using fMRI-prompted LLM
by: Chen, Xiaoyu, et al.
Published: (2025)

Think Outside the Data: Colonial Biases and Systemic Issues in Automated Moderation Pipelines for Low-Resource Languages
by: Shahid, Farhana, et al.
Published: (2025)

Automated Coding of Communications in Collaborative Problem-solving Tasks Using ChatGPT
by: Hao, Jiangang, et al.
Published: (2024)

GPT-4 is judged more human than humans in displaced and inverted Turing tests
by: Rathi, Ishika, et al.
Published: (2024)

LLM-TA: An LLM-Enhanced Thematic Analysis Pipeline for Transcripts from Parents of Children with Congenital Heart Disease
by: Raza, Muhammad Zain, et al.
Published: (2025)

GesGPT: Speech Gesture Synthesis With Text Parsing from ChatGPT
by: Gao, Nan, et al.
Published: (2023)

Can GPT-4 Help Detect Quit Vaping Intentions? An Exploration of Automatic Data Annotation Approach
by: Vuruma, Sai Krishna Revanth, et al.
Published: (2024)

"You tell me": A Dataset of GPT-4-Based Behaviour Change Support Conversations
by: Meyer, Selina, et al.
Published: (2024)

Inspo: Writing with Crowds Alongside AI
by: Huang, Chieh-Yang, et al.
Published: (2023)

Redefining Research Crowdsourcing: Incorporating Human Feedback with LLM-Powered Digital Twins
by: Chan, Amanda, et al.
Published: (2025)

Comparing How a Chatbot References User Utterances from Previous Chatting Sessions: An Investigation of Users' Privacy Concerns and Perceptions
by: Cox, Samuel Rhys, et al.
Published: (2023)

Prompting ChatGPT for Translation: A Comparative Analysis of Translation Brief and Persona Prompts
by: He, Sui
Published: (2024)

When ChatGPT is gone: Creativity reverts and homogeneity persists
by: Liu, Qinghan, et al.
Published: (2024)

GPT-5 Model Corrected GPT-4V's Chart Reading Errors, Not Prompting
by: Yang, Kaichun, et al.
Published: (2025)

Designing LLM Chains by Adapting Techniques from Crowdsourcing Workflows
by: Grunde-McLaughlin, Madeleine, et al.
Published: (2023)

Efficient Online Crowdsourcing with Complex Annotations
by: Meir, Reshef, et al.
Published: (2024)

Understanding How Paper Writers Use AI-Generated Captions in Figure Caption Writing
by: Yin, Ho, et al.
Published: (2025)

Effects of Different Prompts on the Quality of GPT-4 Responses to Dementia Care Questions
by: Li, Zhuochun, et al.
Published: (2024)

Efficiency and Effectiveness of LLM-Based Summarization of Evidence in Crowdsourced Fact-Checking
by: Roitero, Kevin, et al.
Published: (2025)

Customizing ChatGPT for Second Language Speaking Practice: Genuine Support or Just a Marketing Gimmick?
by: Meng, Fanfei
Published: (2026)

EEVEE: An Easy Annotation Tool for Natural Language Processing
by: Sorensen, Axel, et al.
Published: (2024)

MEGAnno+: A Human-LLM Collaborative Annotation System
by: Kim, Hannah, et al.
Published: (2024)

Capabilities of GPT-5 across critical domains: Is it the next breakthrough?
by: Georgiou, Georgios P.
Published: (2025)

Applications, challenges and ethical issues of AI and ChatGPT in education
by: Sidiropoulos, Dimitrios, et al.
Published: (2024)