Cracking CodeWhisperer: Analyzing Developers' Interactions and Patterns During Programming Tasks
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909842080268288 |
|---|---|
| author | Javahar, Jeena Budhrani, Tanya Basha, Manaal de Souza, Cleidson R. B. Beschastnikh, Ivan Rodriguez-Perez, Gema |
| author_facet | Javahar, Jeena Budhrani, Tanya Basha, Manaal de Souza, Cleidson R. B. Beschastnikh, Ivan Rodriguez-Perez, Gema |
| contents | The use of AI code-generation tools is becoming increasingly common, making it important to understand how software developers are adopting these tools. In this study, we investigate how developers engage with Amazon's CodeWhisperer, an LLM-based code-generation tool. We conducted two user studies with two groups of 10 participants each, interacting with CodeWhisperer - the first to understand which interactions were critical to capture and the second to collect low-level interaction data using a custom telemetry plugin. Our mixed-methods analysis identified four behavioral patterns: 1) incremental code refinement, 2) explicit instruction using natural language comments, 3) baseline structuring with model suggestions, and 4) integrative use with external sources. We provide a comprehensive analysis of these patterns . |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_11516 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Cracking CodeWhisperer: Analyzing Developers' Interactions and Patterns During Programming Tasks Javahar, Jeena Budhrani, Tanya Basha, Manaal de Souza, Cleidson R. B. Beschastnikh, Ivan Rodriguez-Perez, Gema Software Engineering Artificial Intelligence The use of AI code-generation tools is becoming increasingly common, making it important to understand how software developers are adopting these tools. In this study, we investigate how developers engage with Amazon's CodeWhisperer, an LLM-based code-generation tool. We conducted two user studies with two groups of 10 participants each, interacting with CodeWhisperer - the first to understand which interactions were critical to capture and the second to collect low-level interaction data using a custom telemetry plugin. Our mixed-methods analysis identified four behavioral patterns: 1) incremental code refinement, 2) explicit instruction using natural language comments, 3) baseline structuring with model suggestions, and 4) integrative use with external sources. We provide a comprehensive analysis of these patterns . |
| title | Cracking CodeWhisperer: Analyzing Developers' Interactions and Patterns During Programming Tasks |
| topic | Software Engineering Artificial Intelligence |
| url | https://arxiv.org/abs/2510.11516 |