Doc2OracLL: Investigating the Impact of Documentation on LLM-based Test Oracle Generation

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Hossain, Soneya Binta, Taylor, Raygan, Dwyer, Matthew
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866916661516304384
author Hossain, Soneya Binta
Taylor, Raygan
Dwyer, Matthew
author_facet Hossain, Soneya Binta
Taylor, Raygan
Dwyer, Matthew
contents Code documentation is a critical aspect of software development, serving as a bridge between human understanding and machine-readable code. Beyond assisting developers in understanding and maintaining code, documentation also plays a critical role in automating various software engineering tasks, such as test oracle generation (TOG). In Java, Javadoc comments provide structured, natural language documentation embedded directly in the source code, typically detailing functionality, usage, parameters, return values, and exceptions. While prior research has utilized Javadoc comments in test oracle generation (TOG), there has not been a thorough investigation into their impact when combined with other contextual information, nor into identifying the most relevant components for generating correct and strong test oracles, or understanding their role in detecting real bugs. In this study, we dive deep into investigating the impact of Javadoc comments on TOG.
format Preprint
id arxiv_https___arxiv_org_abs_2412_09360
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Doc2OracLL: Investigating the Impact of Documentation on LLM-based Test Oracle Generation
Hossain, Soneya Binta
Taylor, Raygan
Dwyer, Matthew
Software Engineering
Code documentation is a critical aspect of software development, serving as a bridge between human understanding and machine-readable code. Beyond assisting developers in understanding and maintaining code, documentation also plays a critical role in automating various software engineering tasks, such as test oracle generation (TOG). In Java, Javadoc comments provide structured, natural language documentation embedded directly in the source code, typically detailing functionality, usage, parameters, return values, and exceptions. While prior research has utilized Javadoc comments in test oracle generation (TOG), there has not been a thorough investigation into their impact when combined with other contextual information, nor into identifying the most relevant components for generating correct and strong test oracles, or understanding their role in detecting real bugs. In this study, we dive deep into investigating the impact of Javadoc comments on TOG.
title Doc2OracLL: Investigating the Impact of Documentation on LLM-based Test Oracle Generation
topic Software Engineering
url https://arxiv.org/abs/2412.09360