Cover Image

Automating Data Annotation under Strategic Human Agents: Risks and Potential Solutions

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Xie, Tian, Zhang, Xueru
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

How Strategic Agents Respond: Comparing Analytical Models with LLM-Generated Responses in Strategic Classification
by: Xie, Tian, et al.
Published: (2025)

Non-linear Welfare-Aware Strategic Learning
by: Xie, Tian, et al.
Published: (2024)

When and How Human Curation Backfires: Preference Alignment under Multi-Model Self-Consuming Loop
by: Zhang, Yang, et al.
Published: (2026)

Addressing Polarization and Unfairness in Performative Prediction
by: Jin, Kun, et al.
Published: (2024)

Lookahead Counterfactual Fairness
by: Zuo, Zhiqun, et al.
Published: (2024)

Learning under Imitative Strategic Behavior with Unforeseeable Outcomes
by: Xie, Tian, et al.
Published: (2024)

Structured Exploration and Exploitation of Label Functions for Automated Data Annotation
by: Lam, Phong, et al.
Published: (2026)

Training Generalizable Collaborative Agents via Strategic Risk Aversion
by: Qu, Chengrui, et al.
Published: (2026)

CORA: Conformal Risk-Controlled Agents for Safeguarded Mobile GUI Automation
by: Feng, Yushi, et al.
Published: (2026)

Tail-Risk-Safe Monte Carlo Tree Search under PAC-Level Guarantees
by: Zhang, Zuyuan, et al.
Published: (2025)

Algorithmic Decision-Making under Agents with Persistent Improvement
by: Xie, Tian, et al.
Published: (2024)

Emergent Risk Awareness in Rational Agents under Resource Constraints
by: Ornia, Daniel Jarne, et al.
Published: (2025)

AgentGA: Evolving Code Solutions in Agent-Seed Space
by: Tan, David Y. Y., et al.
Published: (2026)

A Survey of Reinforcement Learning for Large Language Models under Data Scarcity: Challenges and Solutions
by: Yu, Zhiyin, et al.
Published: (2026)

The ALCHEmist: Automated Labeling 500x CHEaper Than LLM Data Annotators
by: Huang, Tzu-Heng, et al.
Published: (2024)

GenoTEX: An LLM Agent Benchmark for Automated Gene Expression Data Analysis
by: Liu, Haoyang, et al.
Published: (2024)

Automated Filtering of Human Feedback Data for Aligning Text-to-Image Diffusion Models
by: Yang, Yongjin, et al.
Published: (2024)

CleanAgent: Automating Data Standardization with LLM-based Agents
by: Qi, Danrui, et al.
Published: (2024)

COBRA: Contextual Bandit Algorithm for Ensuring Truthful Strategic Agents
by: Verma, Arun, et al.
Published: (2025)

RF-Agent: Automated Reward Function Design via Language Agent Tree Search
by: Gao, Ning, et al.
Published: (2026)

Generalizable Error Modeling for Human Data Annotation: Evidence From an Industry-Scale Search Data Annotation Program
by: Peters, Heinrich, et al.
Published: (2023)

$Agent^2$: An Agent-Generates-Agent Framework for Reinforcement Learning Automation
by: Wei, Yuan, et al.
Published: (2025)

Understanding Reasoning in LLMs through Strategic Information Allocation under Uncertainty
by: Kim, Jeonghye, et al.
Published: (2026)

Risk-aware Direct Preference Optimization under Nested Risk Measure
by: Zhang, Lijun, et al.
Published: (2025)

Optimal Policy Learning with Observational Data in Multi-Action Scenarios: Estimation, Risk Preference, and Potential Failures
by: Cerulli, Giovanni
Published: (2024)

SynCircuit: Automated Generation of New Synthetic RTL Circuits Can Enable Big Data in Circuits
by: Liu, Shang, et al.
Published: (2025)

Evaluating Menu OCR and Translation: A Benchmark for Aligning Human and Automated Evaluations in Large Vision-Language Models
by: Wu, Zhanglin, et al.
Published: (2025)

MLE-Smith: Scaling MLE Tasks with Automated Multi-Agent Pipeline
by: Qiang, Rushi, et al.
Published: (2025)

Data Interpreter: An LLM Agent For Data Science
by: Hong, Sirui, et al.
Published: (2024)

HyPAC: Cost-Efficient LLMs-Human Hybrid Annotation with PAC Error Guarantees
by: Zeng, Hao, et al.
Published: (2026)

GUI-GENESIS: Automated Synthesis of Efficient Environments with Verifiable Rewards for GUI Agent Post-Training
by: Cao, Yuan, et al.
Published: (2026)

Potential Outcome Rankings for Counterfactual Decision Making
by: Kawakami, Yuta, et al.
Published: (2025)

Automating Agent Hijacking via Structural Template Injection
by: Deng, Xinhao, et al.
Published: (2026)

HEMERA: A Human-Explainable Transformer Model for Estimating Lung Cancer Risk using GWAS Data
by: Mahbub, Maria, et al.
Published: (2025)

Kolb-Based Experiential Learning for Generalist Agents with Human-Level Kaggle Data Science Performance
by: Grosnit, Antoine, et al.
Published: (2024)

A Dual-Agent Adversarial Framework for Robust Generalization in Deep Reinforcement Learning
by: Xie, Zhengpeng, et al.
Published: (2025)

Automated Model Selection for Tabular Data
by: Amballa, Avinash, et al.
Published: (2024)

RiskWebWorld: A Realistic Interactive Benchmark for GUI Agents in E-commerce Risk Management
by: Chen, Renqi, et al.
Published: (2026)

$\texttt{PatentAgent}$: Intelligent Agent for Automated Pharmaceutical Patent Analysis
by: Wang, Xin, et al.
Published: (2024)

HelpSteer3-Preference: Open Human-Annotated Preference Data across Diverse Tasks and Languages
by: Wang, Zhilin, et al.
Published: (2025)