Measuring the Runtime Performance of C++ Code Written by Humans using GitHub Copilot
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910741021327360 |
|---|---|
| author | Erhabor, Daniel Udayashankar, Sreeharsha Nagappan, Meiyappan Al-Kiswany, Samer |
| author_facet | Erhabor, Daniel Udayashankar, Sreeharsha Nagappan, Meiyappan Al-Kiswany, Samer |
| contents | GitHub Copilot is an artificially intelligent programming assistant used by many developers. While a few studies have evaluated the security risks of using Copilot, there has not been any study to show if it aids developers in producing code with better runtime performance. We evaluate the runtime performance of C++ code produced when developers use GitHub Copilot versus when they do not. To this end, we conducted a user study with 32 participants where each participant solved two C++ programming problems, one with Copilot and the other without it and measured the runtime performance of the participants' solutions on our test data. Our results suggest that using Copilot may produce C++ code with (statistically significant) slower runtime performance. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2305_06439 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Measuring the Runtime Performance of C++ Code Written by Humans using GitHub Copilot Erhabor, Daniel Udayashankar, Sreeharsha Nagappan, Meiyappan Al-Kiswany, Samer Software Engineering GitHub Copilot is an artificially intelligent programming assistant used by many developers. While a few studies have evaluated the security risks of using Copilot, there has not been any study to show if it aids developers in producing code with better runtime performance. We evaluate the runtime performance of C++ code produced when developers use GitHub Copilot versus when they do not. To this end, we conducted a user study with 32 participants where each participant solved two C++ programming problems, one with Copilot and the other without it and measured the runtime performance of the participants' solutions on our test data. Our results suggest that using Copilot may produce C++ code with (statistically significant) slower runtime performance. |
| title | Measuring the Runtime Performance of C++ Code Written by Humans using GitHub Copilot |
| topic | Software Engineering |
| url | https://arxiv.org/abs/2305.06439 |