Cover Image

Evaluating the Effectiveness of Large Language Models in Solving Simple Programming Tasks: A User-Centered Study

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Deng, Kai
Format:	Preprint
Published:	2025
Subjects:	Human-Computer Interaction Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Lexara: A User-Centered Toolkit for Evaluating Large Language Models for Conversational Visual Analytics
by: Palani, Srishti, et al.
Published: (2026)

Cocobo: Exploring Large Language Models as the Engine for End-User Robot Programming
by: Ge, Yate, et al.
Published: (2024)

The Effectiveness of Style Vectors for Steering Large Language Models: A Human Evaluation
by: Diallo, Diaoulé, et al.
Published: (2026)

Large Language Models Meet User Interfaces: The Case of Provisioning Feedback
by: Pozdniakov, Stanislav, et al.
Published: (2024)

Developing and Evaluating a Large Language Model-Based Automated Feedback System Grounded in Evidence-Centered Design for Supporting Physics Problem Solving
by: Maus, Holger, et al.
Published: (2025)

Large Language Models as Conversational Movie Recommenders: A User Study
by: Sun, Ruixuan, et al.
Published: (2024)

EvalLM: Interactive Evaluation of Large Language Model Prompts on User-Defined Criteria
by: Kim, Tae Soo, et al.
Published: (2023)

Broadening Access to Simulations for End-Users via Large Language Models: Challenges and Opportunities
by: Giabbanelli, Philippe J., et al.
Published: (2024)

Interactions with Prompt Problems: A New Way to Teach Programming with Large Language Models
by: Prather, James, et al.
Published: (2024)

Addressing and Visualizing Misalignments in Human Task-Solving Trajectories
by: Kim, Sejin, et al.
Published: (2024)

Knowledge Sharing in Manufacturing using Large Language Models: User Evaluation and Model Benchmarking
by: Freire, Samuel Kernan, et al.
Published: (2024)

Intersectional Sycophancy: How Perceived User Demographics Shape False Validation in Large Language Models
by: Maltbie, Benjamin, et al.
Published: (2026)

TwIPS: A Large Language Model Powered Texting Application to Simplify Conversational Nuances for Autistic Users
by: Haroon, Rukhshan, et al.
Published: (2024)

Driver Assistant: Persuading Drivers to Adjust Secondary Tasks Using Large Language Models
by: Xiang, Wei, et al.
Published: (2025)

Human-Centered LLM-Agent User Interface: A Position Paper
by: Chin, Daniel, et al.
Published: (2024)

A Causality-aware Paradigm for Evaluating Creativity of Multimodal Large Language Models
by: Huang, Zhongzhan, et al.
Published: (2025)

"I'm Not Sure, But...": Examining the Impact of Large Language Models' Uncertainty Expression on User Reliance and Trust
by: Kim, Sunnie S. Y., et al.
Published: (2024)

Unraveling the Dilemma of AI Errors: Exploring the Effectiveness of Human and Machine Explanations for Large Language Models
by: Pafla, Marvin, et al.
Published: (2024)

Optimizing SIA Development: A Case Study in User-Centered Design for Estuary, a Multimodal Socially Interactive Agent Framework
by: Lin, Spencer, et al.
Published: (2025)

Rethinking Theory of Mind Benchmarks for LLMs: Towards A User-Centered Perspective
by: Wang, Qiaosi, et al.
Published: (2025)

Beyond Final Answers: Evaluating Large Language Models for Math Tutoring
by: Gupta, Adit, et al.
Published: (2025)

Understand User Opinions of Large Language Models via LLM-Powered In-the-Moment User Experience Interviews
by: Liu, Mengqiao, et al.
Published: (2025)

User Intent to Use DeepSeek for Healthcare Purposes and their Trust in the Large Language Model: Multinational Survey Study
by: Choudhury, Avishek, et al.
Published: (2025)

KEditVis: A Visual Analytics System for Knowledge Editing of Large Language Models
by: Chen, Zhenning, et al.
Published: (2026)

Advancing Building Energy Modeling with Large Language Models: Exploration and Case Studies
by: Zhang, Liang, et al.
Published: (2024)

Finding the Signal in the Noise: An Exploratory Study on Assessing the Effectiveness of AI and Accessibility Forums for Blind Users' Support Needs
by: Kodandaram, Satwik Ram, et al.
Published: (2026)

User Misconceptions of LLM-Based Conversational Programming Assistants
by: O'Brien, Gabrielle, et al.
Published: (2025)

Evaluating the Application of Large Language Models to Generate Feedback in Programming Education
by: Jacobs, Sven, et al.
Published: (2024)

Enhancing Large Language Model-Based Systems for End-to-End Circuit Analysis Problem Solving
by: Chen, Liangliang, et al.
Published: (2025)

MHSafeEval: Role-Aware Interaction-Level Evaluation of Mental Health Safety in Large Language Models
by: Lee, Suhyun, et al.
Published: (2026)

Large Language Models Can Solve Real-World Planning Rigorously with Formal Verification Tools
by: Hao, Yilun, et al.
Published: (2024)

RecUserSim: A Realistic and Diverse User Simulator for Evaluating Conversational Recommender Systems
by: Chen, Luyu, et al.
Published: (2025)

Designing Gaze Analytics for ELA Instruction: A User-Centered Dashboard with Conversational AI Support
by: Davalos, Eduardo, et al.
Published: (2025)

Evaluating Usability and Engagement of Large Language Models in Virtual Reality for Traditional Scottish Curling
by: Lau, Ka Hei Carrie, et al.
Published: (2024)

An Evaluation of Estimative Uncertainty in Large Language Models
by: Tang, Zhisheng, et al.
Published: (2024)

Evaluating the Prompt Steerability of Large Language Models
by: Miehling, Erik, et al.
Published: (2024)

Evaluating Social Acceptance of eXtended Reality (XR) Agent Technology: A User Study (Extended Version)
by: Quamara, Megha, et al.
Published: (2025)

See or Recall: A Sanity Check for the Role of Vision in Solving Visualization Question Answer Tasks with Multimodal LLMs
by: Li, Zhimin, et al.
Published: (2025)

Human-AI Collaboration in Large Language Model-Integrated Building Energy Management Systems: The Role of User Domain Knowledge and AI Literacy
by: Jung, Wooyoung, et al.
Published: (2026)

A Protocol for KG Construction Tasks Involving Users
by: Junior, Ademar Crotti, et al.
Published: (2024)