Robustness, Security, Privacy, Explainability, Efficiency, and Usability of Large Language Models for Code

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Yang, Zhou, Sun, Zhensu, Yue, Terry Zhuo, Devanbu, Premkumar, Lo, David
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866929273571377152
author Yang, Zhou
Sun, Zhensu
Yue, Terry Zhuo
Devanbu, Premkumar
Lo, David
author_facet Yang, Zhou
Sun, Zhensu
Yue, Terry Zhuo
Devanbu, Premkumar
Lo, David
contents Large language models for code (LLM4Code), which demonstrate strong performance (e.g., high accuracy) in processing source code, have significantly transformed software engineering. Many studies separately investigate the non-functional properties of LM4Code, but there is no systematic review of how these properties are evaluated and enhanced. This paper fills this gap by thoroughly examining 146 relevant studies, thereby presenting the first systematic literature review to identify seven important properties beyond accuracy, including robustness, security, privacy, explainability, efficiency, and usability. We discuss the current state-of-the-art methods and trends, identify gaps in existing research, and present promising directions for future study.
format Preprint
id arxiv_https___arxiv_org_abs_2403_07506
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Robustness, Security, Privacy, Explainability, Efficiency, and Usability of Large Language Models for Code
Yang, Zhou
Sun, Zhensu
Yue, Terry Zhuo
Devanbu, Premkumar
Lo, David
Software Engineering
Large language models for code (LLM4Code), which demonstrate strong performance (e.g., high accuracy) in processing source code, have significantly transformed software engineering. Many studies separately investigate the non-functional properties of LM4Code, but there is no systematic review of how these properties are evaluated and enhanced. This paper fills this gap by thoroughly examining 146 relevant studies, thereby presenting the first systematic literature review to identify seven important properties beyond accuracy, including robustness, security, privacy, explainability, efficiency, and usability. We discuss the current state-of-the-art methods and trends, identify gaps in existing research, and present promising directions for future study.
title Robustness, Security, Privacy, Explainability, Efficiency, and Usability of Large Language Models for Code
topic Software Engineering
url https://arxiv.org/abs/2403.07506