Cover Image

Will Your Next Pair Programming Partner Be Human? An Empirical Evaluation of Generative AI as a Collaborative Teammate in a Semester-Long Classroom Setting

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Lyu, Wenhan, Wang, Yimeng, Sun, Yifan, Zhang, Yixuan
Format:	Preprint
Published:	2025
Subjects:	Human-Computer Interaction
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Evaluating the Effectiveness of LLMs in Introductory Computer Science Education: A Semester-Long Field Study
by: Lyu, Wenhan, et al.
Published: (2024)

Designing AI Peers for Collaborative Mathematical Problem Solving with Middle School Students: A Participatory Design Study
by: Lyu, Wenhan, et al.
Published: (2026)

Understanding the Practices, Perceptions, and (Dis)Trust of Generative AI among Instructors: A Mixed-methods Study in the U.S. Higher Education
by: Lyu, Wenhan, et al.
Published: (2025)

From Tool to Teammate: LLM Coding Agents as Collaborative Partners for Behavioral Labeling in Educational Dialogue Analysis
by: Chen, Eason, et al.
Published: (2026)

MathVC: An LLM-Simulated Multi-Character Virtual Classroom for Mathematics Education
by: Yue, Murong, et al.
Published: (2024)

Human-Human-AI Triadic Programming: Uncovering the Role of AI Agent and the Value of Human Partner in Collaborative Learning
by: Daryanto, Taufiq, et al.
Published: (2026)

Personality Pairing Improves Human-AI Collaboration
by: Ju, Harang, et al.
Published: (2025)

Agentic AI as Undercover Teammates: Argumentative Knowledge Construction in Hybrid Human-AI Collaborative Learning
by: Yan, Lixiang, et al.
Published: (2025)

Perception of an AI Teammate in an Embodied Control Task Affects Team Performance, Reflected in Human Teammates' Behaviors and Physiological Responses
by: Qin, Yinuo, et al.
Published: (2025)

From Passive Tool to Socio-cognitive Teammate: A Conceptual Framework for Agentic AI in Human-AI Collaborative Learning
by: Yan, Lixiang
Published: (2025)

In Pursuit of Predictive Models of Human Preferences Toward AI Teammates
by: Siu, Ho Chit, et al.
Published: (2025)

Understanding Attitudes and Trust of Generative AI Chatbots for Social Anxiety Support
by: Wang, Yimeng, et al.
Published: (2025)

Interaction Design for Human-AI Choreography Co-creation
by: Liu, Yimeng
Published: (2024)

Partnering with Generative AI: Experimental Evaluation of Human-Led and Model-Led Interaction in Human-AI Co-Creation
by: Maier, Sebastian, et al.
Published: (2025)

AI as a Teaching Partner: Early Lessons from Classroom Codesign with Secondary Teachers
by: Liu, Alex, et al.
Published: (2025)

AI as Teammate or Tool? A Review of Human-AI Interaction in Decision Support
by: Samu, Most. Sharmin Sultana, et al.
Published: (2026)

The Empty Quadrant: AI Teammates for Embodied Field Learning
by: Kim, Hyein, et al.
Published: (2026)

Beyond Competitive Gaming: How Casual Players Evaluate and Respond to Teammate Performance
by: Nathan, Kaushall Senthil, et al.
Published: (2025)

Designing Human and Generative AI Collaboration
by: Hosanagar, Kartik, et al.
Published: (2024)

DanceGen: Supporting Choreography Ideation and Prototyping with Generative AI
by: Liu, Yimeng, et al.
Published: (2024)

MindScratch: A Visual Programming Support Tool for Classroom Learning Based on Multimodal Generative AI
by: Chen, Yunnong, et al.
Published: (2024)

Breaking Barriers or Building Dependency? Exploring Team-LLM Collaboration in AI-infused Classroom Debate
by: Zhang, Zihan, et al.
Published: (2025)

Unexploited Information Value in Human-AI Collaboration
by: Guo, Ziyang, et al.
Published: (2024)

Model Cards for AI Teammates: Comparing Human-AI Team Familiarization Methods for High-Stakes Environments
by: Bowers, Ryan, et al.
Published: (2025)

The AI Collaborator: Bridging Human-AI Interaction in Educational and Professional Settings
by: Samadi, Mohammad Amin, et al.
Published: (2024)

ClassAid: A Real-time Instructor-AI-Student Orchestration System for Classroom Programming Activities
by: Zhang, Gefei, et al.
Published: (2026)

Jokeasy: Exploring Human-AI Collaboration in Thematic Joke Generation
by: Ge, Yate, et al.
Published: (2026)

Helping or Homogenizing? GenAI as a Design Partner to Pre-Service SLPs for Just-in-Time Programming of AAC
by: Zastudil, Cynthia, et al.
Published: (2025)

"Tab, Tab, Bug": Security Pitfalls of Next Edit Suggestions in AI-Integrated IDEs
by: Lyu, Yunlong, et al.
Published: (2026)

Explore LLM-enabled Tools to Facilitate Imaginal Exposure Exercises for Social Anxiety
by: Wang, Yimeng, et al.
Published: (2026)

Exploring AI-assisted Ideation and Prototyping for Choreography
by: Liu, Yimeng, et al.
Published: (2024)

An Exploratory Study on How AI Awareness Impacts Human-AI Design Collaboration
by: Cheng, Zhuoyi, et al.
Published: (2025)

When Thinking Pays Off: Incentive Alignment for Human-AI Collaboration
by: Holstein, Joshua, et al.
Published: (2025)

From Human-Human Collaboration to Human-Agent Collaboration: A Vision, Design Philosophy, and an Empirical Framework for Achieving Successful Partnerships Between Humans and LLM Agents
by: Yao, Bingsheng, et al.
Published: (2026)

Designing and Evaluating Next-Generation Learning Interfaces: Linking AI, HCI, and the Learning Sciences
by: Xia, Meng, et al.
Published: (2026)

Designing Human-AI Systems: Anthropomorphism and Framing Bias on Human-AI Collaboration
by: Olszewski, Samuel Aleksander Sánchez
Published: (2024)

The Human-AI Handshake Framework: A Bidirectional Approach to Human-AI Collaboration
by: Pyae, Aung
Published: (2025)

"The explanation makes sense": An Empirical Study on LLM Performance in News Classification and its Influence on Judgment in Human-AI Collaborative Annotation
by: Wang, Qile, et al.
Published: (2026)

CPVis: Evidence-based Multimodal Learning Analytics for Evaluation in Collaborative Programming
by: Zhang, Gefei, et al.
Published: (2025)

When Teams Embrace AI: Human Collaboration Strategies in Generative Prompting in a Creative Design Task
by: Han, Yuanning, et al.
Published: (2025)