Exploring Interaction Patterns for Debugging: Enhancing Conversational Capabilities of AI-assistants
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866913228965019648 |
|---|---|
| author | Chopra, Bhavya Bajpai, Yasharth Biyani, Param Soares, Gustavo Radhakrishna, Arjun Parnin, Chris Gulwani, Sumit |
| author_facet | Chopra, Bhavya Bajpai, Yasharth Biyani, Param Soares, Gustavo Radhakrishna, Arjun Parnin, Chris Gulwani, Sumit |
| contents | The widespread availability of Large Language Models (LLMs) within Integrated Development Environments (IDEs) has led to their speedy adoption. Conversational interactions with LLMs enable programmers to obtain natural language explanations for various software development tasks. However, LLMs often leap to action without sufficient context, giving rise to implicit assumptions and inaccurate responses. Conversations between developers and LLMs are primarily structured as question-answer pairs, where the developer is responsible for asking the the right questions and sustaining conversations across multiple turns. In this paper, we draw inspiration from interaction patterns and conversation analysis -- to design Robin, an enhanced conversational AI-assistant for debugging. Through a within-subjects user study with 12 industry professionals, we find that equipping the LLM to -- (1) leverage the insert expansion interaction pattern, (2) facilitate turn-taking, and (3) utilize debugging workflows -- leads to lowered conversation barriers, effective fault localization, and 5x improvement in bug resolution rates. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_06229 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Exploring Interaction Patterns for Debugging: Enhancing Conversational Capabilities of AI-assistants Chopra, Bhavya Bajpai, Yasharth Biyani, Param Soares, Gustavo Radhakrishna, Arjun Parnin, Chris Gulwani, Sumit Human-Computer Interaction Artificial Intelligence Software Engineering The widespread availability of Large Language Models (LLMs) within Integrated Development Environments (IDEs) has led to their speedy adoption. Conversational interactions with LLMs enable programmers to obtain natural language explanations for various software development tasks. However, LLMs often leap to action without sufficient context, giving rise to implicit assumptions and inaccurate responses. Conversations between developers and LLMs are primarily structured as question-answer pairs, where the developer is responsible for asking the the right questions and sustaining conversations across multiple turns. In this paper, we draw inspiration from interaction patterns and conversation analysis -- to design Robin, an enhanced conversational AI-assistant for debugging. Through a within-subjects user study with 12 industry professionals, we find that equipping the LLM to -- (1) leverage the insert expansion interaction pattern, (2) facilitate turn-taking, and (3) utilize debugging workflows -- leads to lowered conversation barriers, effective fault localization, and 5x improvement in bug resolution rates. |
| title | Exploring Interaction Patterns for Debugging: Enhancing Conversational Capabilities of AI-assistants |
| topic | Human-Computer Interaction Artificial Intelligence Software Engineering |
| url | https://arxiv.org/abs/2402.06229 |