BISCUIT: Scaffolding LLM-Generated Code with Ephemeral UIs in Computational Notebooks
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866916320269828096 |
|---|---|
| author | Cheng, Ruijia Barik, Titus Leung, Alan Hohman, Fred Nichols, Jeffrey |
| author_facet | Cheng, Ruijia Barik, Titus Leung, Alan Hohman, Fred Nichols, Jeffrey |
| contents | Programmers frequently engage with machine learning tutorials in computational notebooks and have been adopting code generation technologies based on large language models (LLMs). However, they encounter difficulties in understanding and working with code produced by LLMs. To mitigate these challenges, we introduce a novel workflow into computational notebooks that augments LLM-based code generation with an additional ephemeral UI step, offering users UI scaffolds as an intermediate stage between user prompts and code generation. We present this workflow in BISCUIT, an extension for JupyterLab that provides users with ephemeral UIs generated by LLMs based on the context of their code and intentions, scaffolding users to understand, guide, and explore with LLM-generated code. Through a user study where 10 novices used BISCUIT for machine learning tutorials, we found that BISCUIT offers users representations of code to aid their understanding, reduces the complexity of prompt engineering, and creates a playground for users to explore different variables and iterate on their ideas. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_07387 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | BISCUIT: Scaffolding LLM-Generated Code with Ephemeral UIs in Computational Notebooks Cheng, Ruijia Barik, Titus Leung, Alan Hohman, Fred Nichols, Jeffrey Human-Computer Interaction Artificial Intelligence Programmers frequently engage with machine learning tutorials in computational notebooks and have been adopting code generation technologies based on large language models (LLMs). However, they encounter difficulties in understanding and working with code produced by LLMs. To mitigate these challenges, we introduce a novel workflow into computational notebooks that augments LLM-based code generation with an additional ephemeral UI step, offering users UI scaffolds as an intermediate stage between user prompts and code generation. We present this workflow in BISCUIT, an extension for JupyterLab that provides users with ephemeral UIs generated by LLMs based on the context of their code and intentions, scaffolding users to understand, guide, and explore with LLM-generated code. Through a user study where 10 novices used BISCUIT for machine learning tutorials, we found that BISCUIT offers users representations of code to aid their understanding, reduces the complexity of prompt engineering, and creates a playground for users to explore different variables and iterate on their ideas. |
| title | BISCUIT: Scaffolding LLM-Generated Code with Ephemeral UIs in Computational Notebooks |
| topic | Human-Computer Interaction Artificial Intelligence |
| url | https://arxiv.org/abs/2404.07387 |