Simulink Mutation Testing using CodeBERT

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Zhang, Jingfan, Ghobari, Delaram, Sabetzadeh, Mehrdad, Nejati, Shiva
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909455207104512
author Zhang, Jingfan
Ghobari, Delaram
Sabetzadeh, Mehrdad
Nejati, Shiva
author_facet Zhang, Jingfan
Ghobari, Delaram
Sabetzadeh, Mehrdad
Nejati, Shiva
contents We present BERTiMuS, an approach that uses CodeBERT to generate mutants for Simulink models. BERTiMuS converts Simulink models into textual representations, masks tokens from the derived text, and uses CodeBERT to predict the masked tokens. Simulink mutants are obtained by replacing the masked tokens with predictions from CodeBERT. We evaluate BERTiMuS using Simulink models from an industrial benchmark, and compare it with FIM -- a state-of-the-art mutation tool for Simulink. We show that, relying exclusively on CodeBERT, BERTiMuS can generate the block-based Simulink mutation patterns documented in the literature. Further, our results indicate that: (a) BERTiMuS is complementary to FIM, and (b) when one considers a requirements-aware notion of mutation testing, BERTiMuS outperforms FIM.
format Preprint
id arxiv_https___arxiv_org_abs_2501_07553
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Simulink Mutation Testing using CodeBERT
Zhang, Jingfan
Ghobari, Delaram
Sabetzadeh, Mehrdad
Nejati, Shiva
Software Engineering
We present BERTiMuS, an approach that uses CodeBERT to generate mutants for Simulink models. BERTiMuS converts Simulink models into textual representations, masks tokens from the derived text, and uses CodeBERT to predict the masked tokens. Simulink mutants are obtained by replacing the masked tokens with predictions from CodeBERT. We evaluate BERTiMuS using Simulink models from an industrial benchmark, and compare it with FIM -- a state-of-the-art mutation tool for Simulink. We show that, relying exclusively on CodeBERT, BERTiMuS can generate the block-based Simulink mutation patterns documented in the literature. Further, our results indicate that: (a) BERTiMuS is complementary to FIM, and (b) when one considers a requirements-aware notion of mutation testing, BERTiMuS outperforms FIM.
title Simulink Mutation Testing using CodeBERT
topic Software Engineering
url https://arxiv.org/abs/2501.07553