A Systematic Literature Review on Explainability for Machine/Deep Learning-based Software Engineering Research

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Cao, Sicong, Sun, Xiaobing, Widyasari, Ratnadira, Lo, David, Wu, Xiaoxue, Bo, Lili, Zhang, Jiale, Li, Bin, Liu, Wei, Wu, Di, Chen, Yixin
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866913679081996288
author Cao, Sicong
Sun, Xiaobing
Widyasari, Ratnadira
Lo, David
Wu, Xiaoxue
Bo, Lili
Zhang, Jiale
Li, Bin
Liu, Wei
Wu, Di
Chen, Yixin
author_facet Cao, Sicong
Sun, Xiaobing
Widyasari, Ratnadira
Lo, David
Wu, Xiaoxue
Bo, Lili
Zhang, Jiale
Li, Bin
Liu, Wei
Wu, Di
Chen, Yixin
contents The remarkable achievements of Artificial Intelligence (AI) algorithms, particularly in Machine Learning (ML) and Deep Learning (DL), have fueled their extensive deployment across multiple sectors, including Software Engineering (SE). However, due to their black-box nature, these promising AI-driven SE models are still far from being deployed in practice. This lack of explainability poses unwanted risks for their applications in critical tasks, such as vulnerability detection, where decision-making transparency is of paramount importance. This paper endeavors to elucidate this interdisciplinary domain by presenting a systematic literature review of approaches that aim to improve the explainability of AI models within the context of SE. The review canvasses work appearing in the most prominent SE & AI conferences and journals, and spans 108 papers across 23 unique SE tasks. Based on three key Research Questions (RQs), we aim to (1) summarize the SE tasks where XAI techniques have shown success to date; (2) classify and analyze different XAI techniques; and (3) investigate existing evaluation approaches. Based on our findings, we identified a set of challenges remaining to be addressed in existing studies, together with a set of guidelines highlighting potential opportunities we deemed appropriate and important for future work.
format Preprint
id arxiv_https___arxiv_org_abs_2401_14617
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A Systematic Literature Review on Explainability for Machine/Deep Learning-based Software Engineering Research
Cao, Sicong
Sun, Xiaobing
Widyasari, Ratnadira
Lo, David
Wu, Xiaoxue
Bo, Lili
Zhang, Jiale
Li, Bin
Liu, Wei
Wu, Di
Chen, Yixin
Software Engineering
Artificial Intelligence
The remarkable achievements of Artificial Intelligence (AI) algorithms, particularly in Machine Learning (ML) and Deep Learning (DL), have fueled their extensive deployment across multiple sectors, including Software Engineering (SE). However, due to their black-box nature, these promising AI-driven SE models are still far from being deployed in practice. This lack of explainability poses unwanted risks for their applications in critical tasks, such as vulnerability detection, where decision-making transparency is of paramount importance. This paper endeavors to elucidate this interdisciplinary domain by presenting a systematic literature review of approaches that aim to improve the explainability of AI models within the context of SE. The review canvasses work appearing in the most prominent SE & AI conferences and journals, and spans 108 papers across 23 unique SE tasks. Based on three key Research Questions (RQs), we aim to (1) summarize the SE tasks where XAI techniques have shown success to date; (2) classify and analyze different XAI techniques; and (3) investigate existing evaluation approaches. Based on our findings, we identified a set of challenges remaining to be addressed in existing studies, together with a set of guidelines highlighting potential opportunities we deemed appropriate and important for future work.
title A Systematic Literature Review on Explainability for Machine/Deep Learning-based Software Engineering Research
topic Software Engineering
Artificial Intelligence
url https://arxiv.org/abs/2401.14617