Cover Image

AI on AI: Exploring the Utility of GPT as an Expert Annotator of AI Publications

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Toney-Wails, Autumn, Schoeberl, Christian, Dunham, James
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Certain but not Probable? Differentiating Certainty from Probability in LLM Token Outputs for Probabilistic Scenarios
by: Toney-Wails, Autumn, et al.
Published: (2025)

How Clued up are LLMs? Evaluating Multi-Step Deductive Reasoning in a Text-Based Game Environment
by: Ansell, Rebecca, et al.
Published: (2026)

PharmacyGPT: The AI Pharmacist
by: Liu, Zhengliang, et al.
Published: (2023)

Probing Experts' Perspectives on AI-Assisted Public Speaking Training
by: Fourati, Nesrine, et al.
Published: (2025)

OpenAI GPT-5 System Card
by: Singh, Aaditya, et al.
Published: (2025)

Sandpiper: Orchestrated AI-Annotation for Educational Discourse at Scale
by: Hedley, Daryl, et al.
Published: (2026)

Tasks and Roles in Legal AI: Data Curation, Annotation, and Verification
by: Koenecke, Allison, et al.
Published: (2025)

ReasonScaffold: A Scaffolded Reasoning-based Annotation Protocol for Human-AI Co-Annotation
by: Sudheendra, Smitha Muthya, et al.
Published: (2026)

On Evaluating Explanation Utility for Human-AI Decision Making in NLP
by: Chaleshtori, Fateme Hashemi, et al.
Published: (2024)

On Sarcasm Detection with OpenAI GPT-based Models
by: Gole, Montgomery, et al.
Published: (2023)

AIANO: Enhancing Information Retrieval with AI-Augmented Annotation
by: Khattab, Sameh, et al.
Published: (2026)

Applications, challenges and ethical issues of AI and ChatGPT in education
by: Sidiropoulos, Dimitrios, et al.
Published: (2024)

Keeping Humans in the Loop: Human-Centered Automated Annotation with Generative AI
by: Pangakis, Nicholas, et al.
Published: (2024)

CyberPal.AI: Empowering LLMs with Expert-Driven Cybersecurity Instructions
by: Levi, Matan, et al.
Published: (2024)

Exploring AI-Generated Text in Student Writing: How Does AI Help?
by: Woo, David James, et al.
Published: (2023)

AI and the Law: Evaluating ChatGPT's Performance in Legal Classification
by: Weichbroth, Pawel
Published: (2025)

Stability Analysis of ChatGPT-based Sentiment Analysis in AI Quality Assurance
by: Ouyang, Tinghui, et al.
Published: (2024)

Intent Matters: Enhancing AI Tutoring with Fine-Grained Pedagogical Intent Annotation
by: Petukhova, Kseniia, et al.
Published: (2025)

Not Just Novelty: A Longitudinal Study on Utility and Customization of an AI Workflow
by: Long, Tao, et al.
Published: (2024)

Sovereign AI-based Public Services are Viable and Affordable
by: Branco, António, et al.
Published: (2026)

Advancing AI Research Assistants with Expert-Involved Learning
by: Liu, Tianyu, et al.
Published: (2025)

The Future of AI: Exploring the Potential of Large Concept Models
by: Ahmad, Hussain, et al.
Published: (2025)

AITutor-EvalKit: Exploring the Capabilities of AI Tutors
by: Naeem, Numaan, et al.
Published: (2025)

Does Scientific Writing Converge to U.S. English? Evidence from Generative AI-Assisted Publications
by: Filimonovic, Dragan, et al.
Published: (2025)

Minstrel: Structural Prompt Generation with Multi-Agents Coordination for Non-AI Experts
by: Wang, Ming, et al.
Published: (2024)

Alpha-GPT: Human-AI Interactive Alpha Mining for Quantitative Investment
by: Wang, Saizhuo, et al.
Published: (2023)

Does fine-tuning GPT-3 with the OpenAI API leak personally-identifiable information?
by: Sun, Albert Yu, et al.
Published: (2023)

Puzzled By ChatGPT? No more! A Jigsaw Puzzle to Promote AI Literacy and Awareness
by: Padovani, Francesca, et al.
Published: (2026)

AI Slop or AI-enhancement? Student perceptions of AI-generated media for an English for Academic Purposes course
by: Woo, David James, et al.
Published: (2026)

Are Expert-Level Language Models Expert-Level Annotators?
by: Tseng, Yu-Min, et al.
Published: (2024)

Exploring EFL Secondary Students' AI-generated Text Editing While Composition Writing
by: Woo, David James, et al.
Published: (2025)

AI-LieDar: Examine the Trade-off Between Utility and Truthfulness in LLM Agents
by: Su, Zhe, et al.
Published: (2024)

Benchmarked Yet Not Measured -- Generative AI Should be Evaluated Against Real-World Utility
by: Mondal, Ishani, et al.
Published: (2026)

RogueGPT: dis-ethical tuning transforms ChatGPT4 into a Rogue AI in 158 Words
by: Buscemi, Alessio, et al.
Published: (2024)

AI-Based Measurement of Innovation: Mapping Expert Insight into Large Language Model Applications
by: Nowak, Robin, et al.
Published: (2025)

MoMoE: Mixture of Moderation Experts Framework for AI-Assisted Online Governance
by: Goyal, Agam, et al.
Published: (2025)

ClimateGPT: Towards AI Synthesizing Interdisciplinary Research on Climate Change
by: Thulke, David, et al.
Published: (2024)

Generative AI-Based Text Generation Methods Using Pre-Trained GPT-2 Model
by: Pandey, Rohit, et al.
Published: (2024)

RLAIF-V: Open-Source AI Feedback Leads to Super GPT-4V Trustworthiness
by: Yu, Tianyu, et al.
Published: (2024)

TouchAI: Exploring human-AI perceptual alignment in touch through language model representations
by: Zhong, Shu, et al.
Published: (2024)