Cover Image

Why and When LLM-Based Assistants Can Go Wrong: Investigating the Effectiveness of Prompt-Based Interactions for Software Help-Seeking

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Khurana, Anjali, Subramonyam, Hari, Chilana, Parmit K
Format:	Preprint
Published:	2024
Subjects:	Human-Computer Interaction Artificial Intelligence Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Do It For Me vs. Do It With Me: Investigating User Perceptions of Different Paradigms of Automation in Copilots for Feature-Rich Software
by: Khurana, Anjali, et al.
Published: (2025)

"I Just Need GPT to Refine My Prompts": Rethinking Onboarding and Help-Seeking with Generative 3D Modeling Tools
by: Gautam, Kanak, et al.
Published: (2026)

Thinking Assistants: LLM-Based Conversational Assistants that Help Users Think By Asking rather than Answering
by: Park, Soya, et al.
Published: (2023)

Thinking Like a Scientist: Can Interactive Simulations Foster Critical AI Literacy?
by: Zhao, Yiling, et al.
Published: (2025)

Tracing Everyday AI Literacy Discussions at Scale: How Online Creative Communities Make Sense of Generative AI
by: Liu, Haidan, et al.
Published: (2026)

Script&Shift: A Layered Interface Paradigm for Integrating Content Development and Rhetorical Strategy with LLM Writing Assistants
by: Siddiqui, Momin, et al.
Published: (2025)

How Creatives Approach GenAI Image Generation: Tensions Between Structured Guidance, Self-Experimentation, and Creative Autonomy
by: Liu, Haidan, et al.
Published: (2026)

AI in the Writing Process: How Purposeful AI Support Fosters Student Writing
by: Siddiqui, Momin N., et al.
Published: (2025)

ConvoLearn: A Learning Sciences Grounded Dataset for Fine-Tuning Dialogic AI Tutors
by: Sharma, Mayank, et al.
Published: (2026)

Prototyping with Prompts: Emerging Approaches and Challenges in Generative AI Design for Collaborative Software Teams
by: Subramonyam, Hari, et al.
Published: (2024)

SimStep: Chain-of-Abstractions for Incremental Specification and Debugging of AI-Generated Interactive Simulations
by: Kaputa, Zoe, et al.
Published: (2025)

When LLMs Help -- and Hurt -- Teaching Assistants in Proof-Based Courses
by: Mahinpei, Romina, et al.
Published: (2026)

Can Generative AI Support Patients' & Caregivers' Informational Needs? Towards Task-Centric Evaluation Of AI Systems
by: Rajagopal, Shreya, et al.
Published: (2024)

User Misconceptions of LLM-Based Conversational Programming Assistants
by: O'Brien, Gabrielle, et al.
Published: (2025)

Unpacking Vibe Coding: Help-Seeking Processes in Student-AI Interactions While Programming
by: Rinja, Daiana, et al.
Published: (2026)

AltCanvas: A Tile-Based Image Editor with Generative AI for Blind or Visually Impaired People
by: Lee, Seonghee, et al.
Published: (2024)

When "A Helpful Assistant" Is Not Really Helpful: Personas in System Prompts Do Not Improve Performances of Large Language Models
by: Zheng, Mingqian, et al.
Published: (2023)

DraftMarks: Enhancing Transparency in Human-AI Co-Writing Through Interactive Skeuomorphic Process Traces
by: Siddiqui, Momin N., et al.
Published: (2025)

When LLMs Can't Help: Real-World Evaluation of LLMs in Nutrition
by: Li, Karen Jia-Hui, et al.
Published: (2025)

ARChef: An iOS-Based Augmented Reality Cooking Assistant Powered by Multimodal Gemini LLM
by: Vir, Rithik, et al.
Published: (2024)

Nanomentoring: Investigating How Quickly People Can Help People Learn Feature-Rich Software
by: Drosos, Ian, et al.
Published: (2026)

From Prompts to Propositions: A Logic-Based Lens on Student-LLM Interactions
by: Alfageeh, Ali, et al.
Published: (2025)

Explaining Why Things Go Where They Go: Interpretable Constructs of Human Organizational Preferences
by: Fashae, Emmanuel, et al.
Published: (2025)

PromptMap: An Alternative Interaction Style for AI-Based Image Generation
by: Adamkiewicz, Krzysztof, et al.
Published: (2025)

Teaching Spell Checkers to Teach: Pedagogical Program Synthesis for Interactive Learning
by: Siddiqui, Momin N., et al.
Published: (2025)

Deaf and Hard of Hearing Access to Intelligent Personal Assistants: Comparison of Voice-Based Options with an LLM-Powered Touch Interface
by: DeVries, Paige S., et al.
Published: (2026)

Large Language Models Help Humans Verify Truthfulness -- Except When They Are Convincingly Wrong
by: Si, Chenglei, et al.
Published: (2023)

The Impact of LLM-Assistants on Software Developer Productivity: A Systematic Review and Mapping Study
by: Mohamed, Amr, et al.
Published: (2025)

Tutorly: Turning Programming Videos Into Apprenticeship Learning Environments with LLMs
by: Li, Wengxi, et al.
Published: (2024)

Prompt-with-Me: in-IDE Structured Prompt Management for LLM-Driven Software Engineering
by: Li, Ziyou, et al.
Published: (2025)

"My Grade is Wrong!": A Contestable AI Framework for Interactive Feedback in Evaluating Student Essays
by: Hong, Shengxin, et al.
Published: (2024)

CodeVaani: A Multilingual, Voice-Based Code Learning Assistant
by: Havare, Jayant, et al.
Published: (2025)

Understanding, Protecting, and Augmenting Human Cognition with Generative AI: A Synthesis of the CHI 2025 Tools for Thought Workshop
by: Tankelevitch, Lev, et al.
Published: (2025)

Human and LLM-Based Voice Assistant Interaction: An Analytical Framework for User Verbal and Nonverbal Behaviors
by: Chan, Szeyi, et al.
Published: (2024)

LAPPI: Interactive Optimization with LLM-Assisted Preference-Based Problem Instantiation
by: Kuroki, So, et al.
Published: (2025)

The Evolution of Information Seeking in Software Development: Understanding the Role and Impact of AI Assistants
by: Haque, Ebtesam Al, et al.
Published: (2024)

AI-Enhanced Sensemaking: Exploring the Design of a Generative AI-Based Assistant to Support Genetic Professionals
by: Mastrianni, Angela, et al.
Published: (2024)

When Scaffolding Breaks: Investigating Student Interaction with LLM-Based Writing Support in Real-Time K-12 EFL Classrooms
by: Myung, Junho, et al.
Published: (2025)

Can ChatGPT Play the Role of a Teaching Assistant in an Introductory Programming Course?
by: Anishka, et al.
Published: (2023)

Seeking Information with RAG-Assistants: Does Model Size Matter in Human-AI Collaborations?
by: Froma, Lennard C., et al.
Published: (2026)