Imagen de Portada

The Perspectivist Paradigm Shift: Assumptions and Challenges of Capturing Human Labels

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Fleisig, Eve, Blodgett, Su Lin, Klein, Dan, Talat, Zeerak
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning Computation and Language Computers and Society
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

A Capabilities Approach to Studying Bias and Harm in Language Technologies
por: Nigatu, Hellina Hailu, et al.
Publicado: (2024)

Linguistic Bias in ChatGPT: Language Models Reinforce Dialect Discrimination
por: Fleisig, Eve, et al.
Publicado: (2024)

Understanding "Democratization" in NLP and ML Research
por: Subramonian, Arjun, et al.
Publicado: (2024)

Subjective $\textit{Isms}$? On the Danger of Conflating Hate and Offence in Abusive Language Detection
por: Curry, Amanda Cercas, et al.
Publicado: (2024)

Impoverished Language Technology: The Lack of (Social) Class in NLP
por: Curry, Amanda Cercas, et al.
Publicado: (2024)

FedMental: Evaluating Federated Learning for Mental Health Detection from Social Media Data
por: Abdelkadir, Nuredin Ali, et al.
Publicado: (2026)

Balancing Quality and Variation: Spam Filtering Distorts Data Label Distributions
por: Fleisig, Eve, et al.
Publicado: (2025)

When the Majority is Wrong: Modeling Annotator Disagreement for Subjective Tasks
por: Fleisig, Eve, et al.
Publicado: (2023)

MLLM-as-a-Judge for Image Safety without Human Labeling
por: Wang, Zhenting, et al.
Publicado: (2024)

Exploitation All the Way Down: Calling out the Root Cause of Bad Online Experiences for Users of the "Majority World"
por: Nigatu, Hellina Hailu, et al.
Publicado: (2024)

PluriHarms: Benchmarking the Full Spectrum of Human Judgments on AI Harm
por: Li, Jing-Jing, et al.
Publicado: (2026)

Augmenting Human-Annotated Training Data with Large Language Model Generation and Distillation in Open-Response Assessment
por: Borchers, Conrad, et al.
Publicado: (2025)

Protected group bias and stereotypes in Large Language Models
por: Kotek, Hadas, et al.
Publicado: (2024)

Position: the Stochastic Parrot in the Coal Mine. Model Collapse is a Threat to Low-Resource Communities
por: Jarvis, Devon, et al.
Publicado: (2026)

Questionnaire Responses Do not Capture the Safety of AI Agents
por: Hellrigel-Holderbaum, Max, et al.
Publicado: (2026)

Ghostbuster: Detecting Text Ghostwritten by Large Language Models
por: Verma, Vivek, et al.
Publicado: (2023)

LLM Analysis of 150+ years of German Parliamentary Debates on Migration Reveals Shift from Post-War Solidarity to Anti-Solidarity in the Last Decade
por: Kostikova, Aida, et al.
Publicado: (2025)

The Dark Side of ChatGPT: Legal and Ethical Challenges from Stochastic Parrots and Hallucination
por: Li, Zihao
Publicado: (2023)

Operationalizing Automated Essay Scoring: A Human-Aware Approach
por: Plasencia-Calaña, Yenisel
Publicado: (2025)

Hypothesis Testing for Quantifying LLM-Human Misalignment in Multiple Choice Settings
por: Hong, Harbin, et al.
Publicado: (2025)

Mapping Social Choice Theory to RLHF
por: Dai, Jessica, et al.
Publicado: (2024)

Diagnosing Hate Speech Classification: Where Do Humans and Machines Disagree, and Why?
por: Yang, Xilin
Publicado: (2024)

Vicarious Offense and Noise Audit of Offensive Speech Classifiers: Unifying Human and Machine Disagreement on What is Offensive
por: Weerasooriya, Tharindu Cyril, et al.
Publicado: (2023)

Challenging Assumptions in Learning Generic Text Style Embeddings
por: Ostheimer, Phil, et al.
Publicado: (2025)

KPoEM: A Human-Annotated Dataset for Emotion Classification and RAG-Based Poetry Generation in Korean Modern Poetry
por: Lim, Iro, et al.
Publicado: (2025)

Simulated Adoption: Decoupling Magnitude and Direction in LLM In-Context Conflict Resolution
por: Zhang, Long, et al.
Publicado: (2026)

Ethics Whitepaper: Whitepaper on Ethical Research into Large Language Models
por: Ungless, Eddie L., et al.
Publicado: (2024)

The Geometric Price of Discrete Logic: Context-driven Manifold Dynamics of Number Representations
por: Zhang, Long, et al.
Publicado: (2026)

Online Learning Defense against Iterative Jailbreak Attacks via Prompt Optimization
por: Kaneko, Masahiro, et al.
Publicado: (2025)

Big AI's Regulatory Capture: Mapping Industry Interference and Government Complicity
por: Birhane, Abeba, et al.
Publicado: (2026)

Humanizing LLMs: A Survey of Psychological Measurements with Tools, Datasets, and Human-Agent Applications
por: Dong, Wenhan, et al.
Publicado: (2025)

Foundational Challenges in Assuring Alignment and Safety of Large Language Models
por: Anwar, Usman, et al.
Publicado: (2024)

Embracing Imperfection: Simulating Students with Diverse Cognitive Levels Using LLM-based Agents
por: Wu, Tao, et al.
Publicado: (2025)

"I Am the One and Only, Your Cyber BFF": Understanding the Impact of GenAI Requires Understanding the Impact of Anthropomorphic AI
por: Cheng, Myra, et al.
Publicado: (2024)

Understanding and Meeting Practitioner Needs When Measuring Representational Harms Caused by LLM-Based Systems
por: Harvey, Emma, et al.
Publicado: (2025)

ELMES: An Automated Framework for Evaluating Large Language Models in Educational Scenarios
por: Wei, Shou'ang, et al.
Publicado: (2025)

LLM Defenses Are Not Robust to Multi-Turn Human Jailbreaks Yet
por: Li, Nathaniel, et al.
Publicado: (2024)

PsychoGAT: A Novel Psychological Measurement Paradigm through Interactive Fiction Games with LLM Agents
por: Yang, Qisen, et al.
Publicado: (2024)

AI-Augmented Predictions: LLM Assistants Improve Human Forecasting Accuracy
por: Schoenegger, Philipp, et al.
Publicado: (2024)

Fairer Preferences Elicit Improved Human-Aligned Large Language Model Judgments
por: Zhou, Han, et al.
Publicado: (2024)