Saved in:
| Main Authors: | , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2405.13565 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910457349013504 |
|---|---|
| author | Vijayvergiya, Manushree Salawa, Małgorzata Budiselić, Ivan Zheng, Dan Lamblin, Pascal Ivanković, Marko Carin, Juanjo Lewko, Mateusz Andonov, Jovan Petrović, Goran Tarlow, Daniel Maniatis, Petros Just, René |
| author_facet | Vijayvergiya, Manushree Salawa, Małgorzata Budiselić, Ivan Zheng, Dan Lamblin, Pascal Ivanković, Marko Carin, Juanjo Lewko, Mateusz Andonov, Jovan Petrović, Goran Tarlow, Daniel Maniatis, Petros Just, René |
| contents | Modern code review is a process in which an incremental code contribution made by a code author is reviewed by one or more peers before it is committed to the version control system. An important element of modern code review is verifying that code contributions adhere to best practices. While some of these best practices can be automatically verified, verifying others is commonly left to human reviewers. This paper reports on the development, deployment, and evaluation of AutoCommenter, a system backed by a large language model that automatically learns and enforces coding best practices. We implemented AutoCommenter for four programming languages (C++, Java, Python, and Go) and evaluated its performance and adoption in a large industrial setting. Our evaluation shows that an end-to-end system for learning and enforcing coding best practices is feasible and has a positive impact on the developer workflow. Additionally, this paper reports on the challenges associated with deploying such a system to tens of thousands of developers and the corresponding lessons learned. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_13565 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | AI-Assisted Assessment of Coding Practices in Modern Code Review Vijayvergiya, Manushree Salawa, Małgorzata Budiselić, Ivan Zheng, Dan Lamblin, Pascal Ivanković, Marko Carin, Juanjo Lewko, Mateusz Andonov, Jovan Petrović, Goran Tarlow, Daniel Maniatis, Petros Just, René Software Engineering Artificial Intelligence Modern code review is a process in which an incremental code contribution made by a code author is reviewed by one or more peers before it is committed to the version control system. An important element of modern code review is verifying that code contributions adhere to best practices. While some of these best practices can be automatically verified, verifying others is commonly left to human reviewers. This paper reports on the development, deployment, and evaluation of AutoCommenter, a system backed by a large language model that automatically learns and enforces coding best practices. We implemented AutoCommenter for four programming languages (C++, Java, Python, and Go) and evaluated its performance and adoption in a large industrial setting. Our evaluation shows that an end-to-end system for learning and enforcing coding best practices is feasible and has a positive impact on the developer workflow. Additionally, this paper reports on the challenges associated with deploying such a system to tens of thousands of developers and the corresponding lessons learned. |
| title | AI-Assisted Assessment of Coding Practices in Modern Code Review |
| topic | Software Engineering Artificial Intelligence |
| url | https://arxiv.org/abs/2405.13565 |