Not the Silver Bullet: LLM-enhanced Programming Error Messages are Ineffective in Practice

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Santos, Eddie Antonio, Becker, Brett A.
Format:	Preprint
Published:	2024
Subjects:	Artificial Intelligence Human-Computer Interaction
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Debugging Without Error Messages: How LLM Prompting Strategy Affects Programming Error Explanation Effectiveness
by: Salmon, Audrey, et al.
Published: (2025)

Using Large Language Models to Enhance Programming Error Messages
by: Leinonen, Juho, et al.
Published: (2022)

Enhancing Programming Error Messages in Real Time with Generative AI
by: Kimmel, Bailey, et al.
Published: (2024)

Not a Silver Bullet for Loneliness: How Attachment and Age Shape Intimacy with AI Companions
by: Ciriello, Raffaele, et al.
Published: (2026)

User Misconceptions of LLM-Based Conversational Programming Assistants
by: O'Brien, Gabrielle, et al.
Published: (2025)

Interactions with Prompt Problems: A New Way to Teach Programming with Large Language Models
by: Prather, James, et al.
Published: (2024)

Justified or Just Convincing? Error Verifiability as a Dimension of LLM Quality
by: Zhu, Xiaoyuan, et al.
Published: (2026)

Personality as Relational Infrastructure: User Perceptions of Personality-Trait-Infused LLM Messaging
by: Hofer, Dominik P., et al.
Published: (2026)

The Evolution of LLM Adoption in Industry Data Curation Practices
by: Qian, Crystal, et al.
Published: (2024)

Goal Recognition via Linear Programming
by: Meneguzzi, Felipe, et al.
Published: (2024)

EmoWear: Exploring Emotional Teasers for Voice Message Interaction on Smartwatches
by: An, Pengcheng, et al.
Published: (2024)

Plausibility as Failure: How LLMs and Humans Co-Construct Epistemic Error
by: Oliveira, Claudia Vale, et al.
Published: (2025)

The Widening Gap: The Benefits and Harms of Generative AI for Novice Programmers
by: Prather, James, et al.
Published: (2024)

MazeMate: An LLM-Powered Chatbot to Support Computational Thinking in Gamified Programming Learning
by: Hou, Chenyu, et al.
Published: (2025)

AI Does Not Alter Perceptions of Text Messages
by: Diamond, N'yoma
Published: (2024)

CodeAid: Evaluating a Classroom Deployment of an LLM-based Programming Assistant that Balances Student and Educator Needs
by: Kazemitabaar, Majeed, et al.
Published: (2024)

Labeling Messages as AI-Generated Does Not Reduce Their Persuasive Effects
by: Gallegos, Isabel O., et al.
Published: (2025)

Error-related Potential Variability: Exploring the Effects on Classification and Transferability
by: Poole, Benjamin, et al.
Published: (2023)

Understanding How Blind Users Handle Object Recognition Errors: Strategies and Challenges
by: Hong, Jonggi, et al.
Published: (2024)

TRAFA: Anticipating User Actions to Reduce Errors in Procedural Tasks with Predictive Feedback
by: Mokhtar, Sassan, et al.
Published: (2026)

Exploring Prompt Engineering Practices in the Enterprise
by: Desmond, Michael, et al.
Published: (2024)

Biased Error Attribution in Multi-Agent Human-AI Systems Under Delayed Feedback
by: Parakh, Teerthaa, et al.
Published: (2026)

Unraveling the Dilemma of AI Errors: Exploring the Effectiveness of Human and Machine Explanations for Large Language Models
by: Pafla, Marvin, et al.
Published: (2024)

ScreenAudit: Detecting Screen Reader Accessibility Errors in Mobile Apps Using Large Language Models
by: Zhong, Mingyuan, et al.
Published: (2025)

Inclusive Practices for Child-Centered AI Design and Testing
by: Dotch, Emani, et al.
Published: (2024)

Leveraging Large Language Models for enhanced personalised user experience in Smart Homes
by: Rey-Jouanchicot, Jordan, et al.
Published: (2024)

Psychological Effect of AI driven marketing tools for beauty/facial feature enhancement
by: Agrawal, Ayushi, et al.
Published: (2025)

Who Validates the Validators? Aligning LLM-Assisted Evaluation of LLM Outputs with Human Preferences
by: Shankar, Shreya, et al.
Published: (2024)

Generalizable Error Modeling for Human Data Annotation: Evidence From an Industry-Scale Search Data Annotation Program
by: Peters, Heinrich, et al.
Published: (2023)

LLM-DaaS: LLM-driven Drone-as-a-Service Operations from Text User Requests
by: Wassim, Lillian, et al.
Published: (2024)

LLM Enhancement with Domain Expert Mental Model to Reduce LLM Hallucination with Causal Prompt Engineering
by: Kovalerchuk, Boris, et al.
Published: (2025)

MobileAgent: enhancing mobile control via human-machine interaction and SOP integration
by: Ding, Tinghe
Published: (2024)

Silver-Tongued and Sundry: Exploring Intersectional Pronouns with ChatGPT
by: Fujii, Takao, et al.
Published: (2024)

Digital twins in sport: Concepts, Taxonomies, Challenges and Practical Potentials
by: Hliš, Tilen, et al.
Published: (2024)

UINav: A Practical Approach to Train On-Device Automation Agents
by: Li, Wei, et al.
Published: (2023)

Upskilling with Generative AI: Practices and Challenges for Freelance Knowledge Workers
by: Imteyaz, Kashif, et al.
Published: (2026)

On the Effect of Robot Errors on Human Teaching Dynamics
by: Huang, Jindan, et al.
Published: (2024)

Key Considerations for Domain Expert Involvement in LLM Design and Evaluation: An Ethnographic Study
by: Szymanski, Annalisa, et al.
Published: (2026)

Determinants of LLM-assisted Decision-Making
by: Eigner, Eva, et al.
Published: (2024)

Visual Fingerprints for LLM Generation Comparison
by: Alnouri, Amal, et al.
Published: (2026)