Cover Image

Can LLMs Replace Manual Annotation of Software Engineering Artifacts?

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ahmed, Toufique, Devanbu, Premkumar, Treude, Christoph, Pradel, Michael
Format:	Preprint
Published:	2024
Subjects:	Software Engineering Human-Computer Interaction Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

CoDocBench: A Dataset for Code-Documentation Alignment in Software Maintenance
by: Pai, Kunal, et al.
Published: (2025)

Studying LLM Performance on Closed- and Open-source Data
by: Ahmed, Toufique, et al.
Published: (2024)

Interacting with AI Reasoning Models: Harnessing "Thoughts" for AI-Driven Software Engineering
by: Treude, Christoph, et al.
Published: (2025)

How Developers Interact with AI: A Taxonomy of Human-AI Collaboration in Software Engineering
by: Treude, Christoph, et al.
Published: (2025)

Automatic Semantic Augmentation of Language Model Prompts (for Code Summarization)
by: Ahmed, Toufique, et al.
Published: (2023)

Towards an Appropriate Level of Reliance on AI: A Preliminary Reliance-Control Framework for AI in Software Engineering
by: Ferino, Samuel, et al.
Published: (2026)

Calibration of Large Language Models on Code Summarization
by: Virk, Yuvraj, et al.
Published: (2024)

Requirements Engineering for Older Adult Digital Health Software: A Systematic Literature Review
by: Xiao, Yuqing, et al.
Published: (2024)

SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering
by: Yang, John, et al.
Published: (2024)

Story Arena: A Multi-Agent Environment for Envisioning the Future of Software Engineering
by: Weisz, Justin D., et al.
Published: (2025)

Human-In-the-Loop Software Development Agents
by: Takerngsaksiri, Wannita, et al.
Published: (2024)

Beyond Code Generation: An Observational Study of ChatGPT Usage in Software Engineering Practice
by: Khojah, Ranim, et al.
Published: (2024)

AI in Software Engineering: Perceived Roles and Their Impact on Adoption
by: Zakharov, Ilya, et al.
Published: (2025)

On the Role and Impact of GenAI Tools in Software Engineering Education
by: Qin, Qiaolin, et al.
Published: (2025)

Trojans in Large Language Models of Code: A Critical Review through a Trigger-Based Taxonomy
by: Hussain, Aftab, et al.
Published: (2024)

Concept-Guided LLM Agents for Human-AI Safety Codesign
by: Geissler, Florian, et al.
Published: (2024)

Towards Realistic Evaluation of Commit Message Generation by Matching Online and Offline Settings
by: Tsvetkov, Petr, et al.
Published: (2024)

Human-in-the-Loop Synthetic Text Data Inspection with Provenance Tracking
by: Kang, Hong Jin, et al.
Published: (2024)

Age Matters: Analyzing Age-Related Discussions in App Reviews
by: Nirmania, Shashiwadana, et al.
Published: (2026)

Smart Paste: Automatically Fixing Copy/Paste for Google Developers
by: Nguyen, Vincent, et al.
Published: (2025)

Enhancing Code LLM Training with Programmer Attention
by: Zhang, Yifan, et al.
Published: (2025)

Scaling Human-AI Coding Collaboration Requires a Governable Consensus Layer
by: Wang, Tianfu, et al.
Published: (2026)

Reading Between the Lines: Modeling User Behavior and Costs in AI-Assisted Programming
by: Mozannar, Hussein, et al.
Published: (2022)

When to Show a Suggestion? Integrating Human Feedback in AI-Assisted Programming
by: Mozannar, Hussein, et al.
Published: (2023)

Do Large Language Models Pay Similar Attention Like Human Programmers When Generating Code?
by: Kou, Bonan, et al.
Published: (2023)

Requirements are All You Need: The Final Frontier for End-User Software Engineering
by: Robinson, Diana, et al.
Published: (2024)

Insights from the Frontline: GenAI Utilization Among Software Engineering Students
by: Choudhuri, Rudrajit, et al.
Published: (2024)

How Far Are We? The Triumphs and Trials of Generative AI in Learning Software Engineering
by: Choudhuri, Rudrajit, et al.
Published: (2023)

EM-Assist: Safe Automated ExtractMethod Refactoring with LLMs
by: Pomian, Dorin, et al.
Published: (2024)

Bridging the Socio-Emotional Gap: The Functional Dimension of Human-AI Collaboration for Software Engineering
by: Rani, Lekshmi Murali, et al.
Published: (2026)

MentalGame: Predicting Personality-Job Fitness for Software Developers Using Multi-Genre Games and Machine Learning Approaches
by: Elyasi, Soroush, et al.
Published: (2026)

Amplifiers or Equalizers? A Longitudinal Study of LLM Evolution in Software Engineering Project-Based Learning
by: Kataoka, Hana, et al.
Published: (2025)

Exploring the Use of ChatGPT by Computer Science Students in Software Development: Applications, Ethical Considerations, and Insights for Engineering Education
by: Xu, Daihan, et al.
Published: (2025)

RepairAgent: An Autonomous, LLM-Based Agent for Program Repair
by: Bouzenia, Islem, et al.
Published: (2024)

Towards Understanding What Code Language Models Learned
by: Ahmed, Toufique, et al.
Published: (2023)

Cognitive Biases in LLM-Assisted Software Development
by: Zhou, Xinyi, et al.
Published: (2026)

Exploring Developer Experience Factors in Software Ecosystems
by: Zacarias, Rodrigo Oliveira, et al.
Published: (2025)

Teaching Agile Requirements Engineering: A Stakeholder Simulation with Generative AI
by: Schön, Eva-Maria, et al.
Published: (2026)

The Impact of Prompt Programming on Function-Level Code Generation
by: Khojah, Ranim, et al.
Published: (2024)

Unlocking Mental Health: Exploring College Students' Well-being through Smartphone Behaviors
by: Xuan, Wei, et al.
Published: (2025)