An Initial Exploration of Fine-tuning Small Language Models for Smart Contract Reentrancy Vulnerability Detection

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Pofcher, Ignacio Mariano Andreozzi, Ellul, Joshua
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866908378893123584
author Pofcher, Ignacio Mariano Andreozzi
Ellul, Joshua
author_facet Pofcher, Ignacio Mariano Andreozzi
Ellul, Joshua
contents Large Language Models (LLMs) are being used more and more for various coding tasks, including to help coders identify bugs and are a promising avenue to support coders in various tasks including vulnerability detection -- particularly given the flexibility of such generative AI models and tools. Yet for many tasks it may not be suitable to use LLMs, for which it may be more suitable to use smaller language models that can fit and easily execute and train on a developer's computer. In this paper we explore and evaluate whether smaller language models can be fine-tuned to achieve reasonable results for a niche area: vulnerability detection -- specifically focusing on detecting the reentrancy bug in Solidity smart contracts.
format Preprint
id arxiv_https___arxiv_org_abs_2505_19059
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle An Initial Exploration of Fine-tuning Small Language Models for Smart Contract Reentrancy Vulnerability Detection
Pofcher, Ignacio Mariano Andreozzi
Ellul, Joshua
Software Engineering
Artificial Intelligence
Emerging Technologies
Machine Learning
Large Language Models (LLMs) are being used more and more for various coding tasks, including to help coders identify bugs and are a promising avenue to support coders in various tasks including vulnerability detection -- particularly given the flexibility of such generative AI models and tools. Yet for many tasks it may not be suitable to use LLMs, for which it may be more suitable to use smaller language models that can fit and easily execute and train on a developer's computer. In this paper we explore and evaluate whether smaller language models can be fine-tuned to achieve reasonable results for a niche area: vulnerability detection -- specifically focusing on detecting the reentrancy bug in Solidity smart contracts.
title An Initial Exploration of Fine-tuning Small Language Models for Smart Contract Reentrancy Vulnerability Detection
topic Software Engineering
Artificial Intelligence
Emerging Technologies
Machine Learning
url https://arxiv.org/abs/2505.19059