AIGCodeSet: A New Annotated Dataset for AI Generated Code Detection
Fuente:
arXiv
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916756043333632 |
|---|---|
| author | Demirok, Basak Kutlu, Mucahid |
| author_facet | Demirok, Basak Kutlu, Mucahid |
| contents | While large language models provide significant convenience for software development, they can lead to ethical issues in job interviews and student assignments. Therefore, determining whether a piece of code is written by a human or generated by an artificial intelligence (AI) model is a critical issue. In this study, we present AIGCodeSet, which consists of 2.828 AI-generated and 4.755 human-written Python codes, created using CodeLlama 34B, Codestral 22B, and Gemini 1.5 Flash. In addition, we share the results of our experiments conducted with baseline detection methods. Our experiments show that a Bayesian classifier outperforms the other models. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_16594 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | AIGCodeSet: A New Annotated Dataset for AI Generated Code Detection Demirok, Basak Kutlu, Mucahid Software Engineering Artificial Intelligence While large language models provide significant convenience for software development, they can lead to ethical issues in job interviews and student assignments. Therefore, determining whether a piece of code is written by a human or generated by an artificial intelligence (AI) model is a critical issue. In this study, we present AIGCodeSet, which consists of 2.828 AI-generated and 4.755 human-written Python codes, created using CodeLlama 34B, Codestral 22B, and Gemini 1.5 Flash. In addition, we share the results of our experiments conducted with baseline detection methods. Our experiments show that a Bayesian classifier outperforms the other models. |
| title | AIGCodeSet: A New Annotated Dataset for AI Generated Code Detection |
| topic | Software Engineering Artificial Intelligence |
| url | https://arxiv.org/abs/2412.16594 |