Enhancing Code Consistency in AI Research with Large Language Models and Retrieval-Augmented Generation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Keshri, Rajat, Zachariah, Arun George, Boone, Michael
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929693666574336
author Keshri, Rajat
Zachariah, Arun George
Boone, Michael
author_facet Keshri, Rajat
Zachariah, Arun George
Boone, Michael
contents Ensuring that code accurately reflects the algorithms and methods described in research papers is critical for maintaining credibility and fostering trust in AI research. This paper presents a novel system designed to verify code implementations against the algorithms and methodologies outlined in corresponding research papers. Our system employs Retrieval-Augmented Generation to extract relevant details from both the research papers and code bases, followed by a structured comparison using Large Language Models. This approach improves the accuracy and comprehensiveness of code implementation verification while contributing to the transparency, explainability, and reproducibility of AI research. By automating the verification process, our system reduces manual effort, enhances research credibility, and ultimately advances the state of the art in code verification.
format Preprint
id arxiv_https___arxiv_org_abs_2502_00611
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Enhancing Code Consistency in AI Research with Large Language Models and Retrieval-Augmented Generation
Keshri, Rajat
Zachariah, Arun George
Boone, Michael
Software Engineering
Artificial Intelligence
Ensuring that code accurately reflects the algorithms and methods described in research papers is critical for maintaining credibility and fostering trust in AI research. This paper presents a novel system designed to verify code implementations against the algorithms and methodologies outlined in corresponding research papers. Our system employs Retrieval-Augmented Generation to extract relevant details from both the research papers and code bases, followed by a structured comparison using Large Language Models. This approach improves the accuracy and comprehensiveness of code implementation verification while contributing to the transparency, explainability, and reproducibility of AI research. By automating the verification process, our system reduces manual effort, enhances research credibility, and ultimately advances the state of the art in code verification.
title Enhancing Code Consistency in AI Research with Large Language Models and Retrieval-Augmented Generation
topic Software Engineering
Artificial Intelligence
url https://arxiv.org/abs/2502.00611