Detección automática de similitud de los programas en el lenguaje de programación Karel basado en técnicas de procesamiento de lenguaje natural
Fuente:
Redalyc
Guardado en:
| Autor principal: | |
|---|---|
| Formato: | Artículo científico |
| Lenguaje: | es |
| Publicado: |
Instituto Politécnico Nacional
2016
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1876469628198191104 |
|---|---|
| author | Grigori Sidorov |
| author_facet | Grigori Sidorov |
| contents | Detección automática de similitud de los programas en el lenguaje de programación Karel basado en técnicas de procesamiento de lenguaje natural Grigori Sidorov Martín Ibarra Romero Ilia Markov Rafael Guzman Cabrera Liliana Chanona-Hernández Francisco Velásquez Computación grams program Similarity source code information retrieval In this paper, we present a method for calculating similarity between programs (source codes). One of the applications of the task is detection of code reuse, for example, in the case of plagiarism. The Karel programming language is used for experiments. In order to determine similarity between Karel programs and/or similar software solutions, we make use of techniques from the fields of natural language processing and information retrieval. These techniques use representations of documents as vectors of features and their values. Usually, the features are n-grams of words or n-grams of characters. In addition, we consider application of the latent semantic analysis for reduction of the number of dimensions of the vector space. Finally, we use a supervised machine learning approach for classification of texts (or programs, which are texts as well) based on their similarity. For evaluation of the proposed method, two corpora were developed: the first corpus is composed of 100 different programs with a total of 9,341 source codes. The second corpus consists of 34 tasks with a total of 374 codes, which are grouped by the proposed solution. Our experiments showed that for the first corpus, the best results were obtained using trigrams of terms (words) accompanied with application of latent semantic analysis, while for the second corpus, the best representation was achieved using character trigrams. 2016 artículo científico 1405-5546 https://www.redalyc.org/articulo.oa?id=61547018010 es http://www.redalyc.org/revista.oa?id=615 Computación y Sistemas application/pdf Instituto Politécnico Nacional Computación y Sistemas (México) Num.2 Vol.20 |
| format | Artículo científico |
| id | redalyc_61547018010 |
| institution | Redalyc |
| language | es |
| publishDate | 2016 |
| publisher | Instituto Politécnico Nacional |
| spellingShingle | Detección automática de similitud de los programas en el lenguaje de programación Karel basado en técnicas de procesamiento de lenguaje natural Grigori Sidorov Computación grams program Similarity source code information retrieval Detección automática de similitud de los programas en el lenguaje de programación Karel basado en técnicas de procesamiento de lenguaje natural Grigori Sidorov Martín Ibarra Romero Ilia Markov Rafael Guzman Cabrera Liliana Chanona-Hernández Francisco Velásquez Computación grams program Similarity source code information retrieval In this paper, we present a method for calculating similarity between programs (source codes). One of the applications of the task is detection of code reuse, for example, in the case of plagiarism. The Karel programming language is used for experiments. In order to determine similarity between Karel programs and/or similar software solutions, we make use of techniques from the fields of natural language processing and information retrieval. These techniques use representations of documents as vectors of features and their values. Usually, the features are n-grams of words or n-grams of characters. In addition, we consider application of the latent semantic analysis for reduction of the number of dimensions of the vector space. Finally, we use a supervised machine learning approach for classification of texts (or programs, which are texts as well) based on their similarity. For evaluation of the proposed method, two corpora were developed: the first corpus is composed of 100 different programs with a total of 9,341 source codes. The second corpus consists of 34 tasks with a total of 374 codes, which are grouped by the proposed solution. Our experiments showed that for the first corpus, the best results were obtained using trigrams of terms (words) accompanied with application of latent semantic analysis, while for the second corpus, the best representation was achieved using character trigrams. 2016 artículo científico 1405-5546 https://www.redalyc.org/articulo.oa?id=61547018010 es http://www.redalyc.org/revista.oa?id=615 Computación y Sistemas application/pdf Instituto Politécnico Nacional Computación y Sistemas (México) Num.2 Vol.20 |
| title | Detección automática de similitud de los programas en el lenguaje de programación Karel basado en técnicas de procesamiento de lenguaje natural |
| topic | Computación grams program Similarity source code information retrieval |
| url | https://www.redalyc.org/articulo.oa?id=61547018010 |