MLIR-Smith: A Novel Random Program Generator for Evaluating Compiler Pipelines

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Ates, Berke, Dobrosavljević, Filip, Theodoridis, Theodoros, Su, Zhendong
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911355404025856
author Ates, Berke
Dobrosavljević, Filip
Theodoridis, Theodoros
Su, Zhendong
author_facet Ates, Berke
Dobrosavljević, Filip
Theodoridis, Theodoros
Su, Zhendong
contents Compilers are essential for the performance and correct execution of software and hold universal relevance across various scientific disciplines. Despite this, there is a notable lack of tools for testing and evaluating them, especially within the adaptable Multi-Level Intermediate Representation (MLIR) context. This paper addresses the need for a tool that can accommodate MLIR's extensibility, a feature not provided by previous methods such as Csmith. Here we introduce MLIR-Smith, a novel random program generator specifically designed to test and evaluate MLIR-based compiler optimizations. We demonstrate the utility of MLIR-Smith by conducting differential testing on MLIR, LLVM, DaCe, and DCIR, which led to the discovery of multiple bugs in these compiler pipelines. The introduction of MLIR-Smith not only fills a void in the realm of compiler testing but also emphasizes the importance of comprehensive testing within these systems. By providing a tool that can generate random MLIR programs, this paper enhances our ability to evaluate and improve compilers and paves the way for future tools, potentially shaping the wider landscape of software testing and quality assurance.
format Preprint
id arxiv_https___arxiv_org_abs_2601_02218
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle MLIR-Smith: A Novel Random Program Generator for Evaluating Compiler Pipelines
Ates, Berke
Dobrosavljević, Filip
Theodoridis, Theodoros
Su, Zhendong
Programming Languages
Software Engineering
Compilers are essential for the performance and correct execution of software and hold universal relevance across various scientific disciplines. Despite this, there is a notable lack of tools for testing and evaluating them, especially within the adaptable Multi-Level Intermediate Representation (MLIR) context. This paper addresses the need for a tool that can accommodate MLIR's extensibility, a feature not provided by previous methods such as Csmith. Here we introduce MLIR-Smith, a novel random program generator specifically designed to test and evaluate MLIR-based compiler optimizations. We demonstrate the utility of MLIR-Smith by conducting differential testing on MLIR, LLVM, DaCe, and DCIR, which led to the discovery of multiple bugs in these compiler pipelines. The introduction of MLIR-Smith not only fills a void in the realm of compiler testing but also emphasizes the importance of comprehensive testing within these systems. By providing a tool that can generate random MLIR programs, this paper enhances our ability to evaluate and improve compilers and paves the way for future tools, potentially shaping the wider landscape of software testing and quality assurance.
title MLIR-Smith: A Novel Random Program Generator for Evaluating Compiler Pipelines
topic Programming Languages
Software Engineering
url https://arxiv.org/abs/2601.02218