Does Programming Language Matter? An Empirical Study of Fuzzing Bug Detection

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Shirai, Tatsuya, Nourry, Olivier, Kashiwa, Yutaro, Fujiwara, Kenji, Iida, Hajimu
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866918323974832128
author Shirai, Tatsuya
Nourry, Olivier
Kashiwa, Yutaro
Fujiwara, Kenji
Iida, Hajimu
author_facet Shirai, Tatsuya
Nourry, Olivier
Kashiwa, Yutaro
Fujiwara, Kenji
Iida, Hajimu
contents Fuzzing has become a popular technique for automatically detecting vulnerabilities and bugs by generating unexpected inputs. In recent years, the fuzzing process has been integrated into continuous integration workflows (i.e., continuous fuzzing), enabling short and frequent testing cycles. Despite its widespread adoption, prior research has not examined whether the effectiveness of continuous fuzzing varies across programming languages. This study conducts a large-scale cross-language analysis to examine how fuzzing bug characteristics and detection efficiency differ among languages. We analyze 61,444 fuzzing bugs and 999,248 builds from 559 OSS-Fuzz projects categorized by primary language. Our findings reveal that (i) C++ and Rust exhibit higher fuzzing bug detection frequencies, (ii) Rust and Python show low vulnerability ratios but tend to expose more critical vulnerabilities, (iii) crash types vary across languages and unreproducible bugs are more frequent in Go but rare in Rust, and (iv) Python attains higher patch coverage but suffers from longer time-to-detection. These results demonstrate that fuzzing behavior and effectiveness are strongly shaped by language design, providing insights for language-aware fuzzing strategies and tool development.
format Preprint
id arxiv_https___arxiv_org_abs_2602_05312
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Does Programming Language Matter? An Empirical Study of Fuzzing Bug Detection
Shirai, Tatsuya
Nourry, Olivier
Kashiwa, Yutaro
Fujiwara, Kenji
Iida, Hajimu
Software Engineering
Fuzzing has become a popular technique for automatically detecting vulnerabilities and bugs by generating unexpected inputs. In recent years, the fuzzing process has been integrated into continuous integration workflows (i.e., continuous fuzzing), enabling short and frequent testing cycles. Despite its widespread adoption, prior research has not examined whether the effectiveness of continuous fuzzing varies across programming languages. This study conducts a large-scale cross-language analysis to examine how fuzzing bug characteristics and detection efficiency differ among languages. We analyze 61,444 fuzzing bugs and 999,248 builds from 559 OSS-Fuzz projects categorized by primary language. Our findings reveal that (i) C++ and Rust exhibit higher fuzzing bug detection frequencies, (ii) Rust and Python show low vulnerability ratios but tend to expose more critical vulnerabilities, (iii) crash types vary across languages and unreproducible bugs are more frequent in Go but rare in Rust, and (iv) Python attains higher patch coverage but suffers from longer time-to-detection. These results demonstrate that fuzzing behavior and effectiveness are strongly shaped by language design, providing insights for language-aware fuzzing strategies and tool development.
title Does Programming Language Matter? An Empirical Study of Fuzzing Bug Detection
topic Software Engineering
url https://arxiv.org/abs/2602.05312