Using ML filters to help automated vulnerability repairs: when it helps and when it doesn't

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Camporese, Maria, Massacci, Fabio
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912318323949568
author Camporese, Maria
Massacci, Fabio
author_facet Camporese, Maria
Massacci, Fabio
contents [Context:] The acceptance of candidate patches in automated program repair has been typically based on testing oracles. Testing requires typically a costly process of building the application while ML models can be used to quickly classify patches, thus allowing more candidate patches to be generated in a positive feedback loop. [Problem:] If the model predictions are unreliable (as in vulnerability detection) they can hardly replace the more reliable oracles based on testing. [New Idea:] We propose to use an ML model as a preliminary filter of candidate patches which is put in front of a traditional filter based on testing. [Preliminary Results:] We identify some theoretical bounds on the precision and recall of the ML algorithm that makes such operation meaningful in practice. With these bounds and the results published in the literature, we calculate how fast some of state-of-the art vulnerability detectors must be to be more effective over a traditional AVR pipeline such as APR4Vuln based just on testing.
format Preprint
id arxiv_https___arxiv_org_abs_2504_07027
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Using ML filters to help automated vulnerability repairs: when it helps and when it doesn't
Camporese, Maria
Massacci, Fabio
Software Engineering
Cryptography and Security
Machine Learning
[Context:] The acceptance of candidate patches in automated program repair has been typically based on testing oracles. Testing requires typically a costly process of building the application while ML models can be used to quickly classify patches, thus allowing more candidate patches to be generated in a positive feedback loop. [Problem:] If the model predictions are unreliable (as in vulnerability detection) they can hardly replace the more reliable oracles based on testing. [New Idea:] We propose to use an ML model as a preliminary filter of candidate patches which is put in front of a traditional filter based on testing. [Preliminary Results:] We identify some theoretical bounds on the precision and recall of the ML algorithm that makes such operation meaningful in practice. With these bounds and the results published in the literature, we calculate how fast some of state-of-the art vulnerability detectors must be to be more effective over a traditional AVR pipeline such as APR4Vuln based just on testing.
title Using ML filters to help automated vulnerability repairs: when it helps and when it doesn't
topic Software Engineering
Cryptography and Security
Machine Learning
url https://arxiv.org/abs/2504.07027