Analyzing LLM Usage in an Advanced Computing Class in India
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866913446441779200 |
|---|---|
| author | Garg, Anupam Raina, Aryaman Gupta, Aryan Singh, Jaskaran Saini, Manav Iiitd, Prachi Mehta, Ronit Oberoi, Rupin Sharma, Sachin Jain, Samyak Tyagi, Sarthak Arora, Utkarsh Kumar, Dhruv |
| author_facet | Garg, Anupam Raina, Aryaman Gupta, Aryan Singh, Jaskaran Saini, Manav Iiitd, Prachi Mehta, Ronit Oberoi, Rupin Sharma, Sachin Jain, Samyak Tyagi, Sarthak Arora, Utkarsh Kumar, Dhruv |
| contents | This study examines the use of large language models (LLMs) by undergraduate and graduate students for programming assignments in advanced computing classes. Unlike existing research, which primarily focuses on introductory classes and lacks in-depth analysis of actual student-LLM interactions, our work fills this gap. We conducted a comprehensive analysis involving 411 students from a Distributed Systems class at an Indian university, where they completed three programming assignments and shared their experiences through Google Form surveys.
Our findings reveal that students leveraged LLMs for a variety of tasks, including code generation, debugging, conceptual inquiries, and test case creation. They employed a spectrum of prompting strategies, ranging from basic contextual prompts to advanced techniques like chain-of-thought prompting and iterative refinement. While students generally viewed LLMs as beneficial for enhancing productivity and learning, we noted a concerning trend of over-reliance, with many students submitting entire assignment descriptions to obtain complete solutions. Given the increasing use of LLMs in the software industry, our study highlights the need to update undergraduate curricula to include training on effective prompting strategies and to raise awareness about the benefits and potential drawbacks of LLM usage in academic settings. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_04603 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Analyzing LLM Usage in an Advanced Computing Class in India Garg, Anupam Raina, Aryaman Gupta, Aryan Singh, Jaskaran Saini, Manav Iiitd, Prachi Mehta, Ronit Oberoi, Rupin Sharma, Sachin Jain, Samyak Tyagi, Sarthak Arora, Utkarsh Kumar, Dhruv Human-Computer Interaction Computers and Society This study examines the use of large language models (LLMs) by undergraduate and graduate students for programming assignments in advanced computing classes. Unlike existing research, which primarily focuses on introductory classes and lacks in-depth analysis of actual student-LLM interactions, our work fills this gap. We conducted a comprehensive analysis involving 411 students from a Distributed Systems class at an Indian university, where they completed three programming assignments and shared their experiences through Google Form surveys. Our findings reveal that students leveraged LLMs for a variety of tasks, including code generation, debugging, conceptual inquiries, and test case creation. They employed a spectrum of prompting strategies, ranging from basic contextual prompts to advanced techniques like chain-of-thought prompting and iterative refinement. While students generally viewed LLMs as beneficial for enhancing productivity and learning, we noted a concerning trend of over-reliance, with many students submitting entire assignment descriptions to obtain complete solutions. Given the increasing use of LLMs in the software industry, our study highlights the need to update undergraduate curricula to include training on effective prompting strategies and to raise awareness about the benefits and potential drawbacks of LLM usage in academic settings. |
| title | Analyzing LLM Usage in an Advanced Computing Class in India |
| topic | Human-Computer Interaction Computers and Society |
| url | https://arxiv.org/abs/2404.04603 |