Augmenting the Generality and Performance of Large Language Models for Software Engineering

Fuente: arXiv
Saved in:
Bibliographic Details
Main Author: Peña, Fabian C.
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913891669245952
author Peña, Fabian C.
author_facet Peña, Fabian C.
contents Large Language Models (LLMs) are revolutionizing software engineering (SE), with special emphasis on code generation and analysis. However, their applications to broader SE practices including conceptualization, design, and other non-code tasks, remain partially underexplored. This research aims to augment the generality and performance of LLMs for SE by (1) advancing the understanding of how LLMs with different characteristics perform on various non-code tasks, (2) evaluating them as sources of foundational knowledge in SE, and (3) effectively detecting hallucinations on SE statements. The expected contributions include a variety of LLMs trained and evaluated on domain-specific datasets, new benchmarks on foundational knowledge in SE, and methods for detecting hallucinations. Initial results in terms of performance improvements on various non-code tasks are promising.
format Preprint
id arxiv_https___arxiv_org_abs_2506_11548
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Augmenting the Generality and Performance of Large Language Models for Software Engineering
Peña, Fabian C.
Software Engineering
Large Language Models (LLMs) are revolutionizing software engineering (SE), with special emphasis on code generation and analysis. However, their applications to broader SE practices including conceptualization, design, and other non-code tasks, remain partially underexplored. This research aims to augment the generality and performance of LLMs for SE by (1) advancing the understanding of how LLMs with different characteristics perform on various non-code tasks, (2) evaluating them as sources of foundational knowledge in SE, and (3) effectively detecting hallucinations on SE statements. The expected contributions include a variety of LLMs trained and evaluated on domain-specific datasets, new benchmarks on foundational knowledge in SE, and methods for detecting hallucinations. Initial results in terms of performance improvements on various non-code tasks are promising.
title Augmenting the Generality and Performance of Large Language Models for Software Engineering
topic Software Engineering
url https://arxiv.org/abs/2506.11548