Insights from Rights and Wrongs: A Large Language Model for Solving Assertion Failures in RTL Design

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Zhou, Jie, Ji, Youshu, Wang, Ning, Hu, Yuchen, Jiao, Xinyao, Yao, Bingkun, Fang, Xinwei, Zhao, Shuai, Guan, Nan, Jiang, Zhe
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866929744364175360
author Zhou, Jie
Ji, Youshu
Wang, Ning
Hu, Yuchen
Jiao, Xinyao
Yao, Bingkun
Fang, Xinwei
Zhao, Shuai
Guan, Nan
Jiang, Zhe
author_facet Zhou, Jie
Ji, Youshu
Wang, Ning
Hu, Yuchen
Jiao, Xinyao
Yao, Bingkun
Fang, Xinwei
Zhao, Shuai
Guan, Nan
Jiang, Zhe
contents SystemVerilog Assertions (SVAs) are essential for verifying Register Transfer Level (RTL) designs, as they can be embedded into key functional paths to detect unintended behaviours. During simulation, assertion failures occur when the design's behaviour deviates from expectations. Solving these failures, i.e., identifying and fixing the issues causing the deviation, requires analysing complex logical and timing relationships between multiple signals. This process heavily relies on human expertise, and there is currently no automatic tool available to assist with it. Here, we present AssertSolver, an open-source Large Language Model (LLM) specifically designed for solving assertion failures. By leveraging synthetic training data and learning from error responses to challenging cases, AssertSolver achieves a bug-fixing pass@1 metric of 88.54% on our testbench, significantly outperforming OpenAI's o1-preview by up to 11.97%. We release our model and testbench for public access to encourage further research: https://github.com/SEU-ACAL/reproduce-AssertSolver-DAC-25.
format Preprint
id arxiv_https___arxiv_org_abs_2503_04057
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Insights from Rights and Wrongs: A Large Language Model for Solving Assertion Failures in RTL Design
Zhou, Jie
Ji, Youshu
Wang, Ning
Hu, Yuchen
Jiao, Xinyao
Yao, Bingkun
Fang, Xinwei
Zhao, Shuai
Guan, Nan
Jiang, Zhe
Hardware Architecture
SystemVerilog Assertions (SVAs) are essential for verifying Register Transfer Level (RTL) designs, as they can be embedded into key functional paths to detect unintended behaviours. During simulation, assertion failures occur when the design's behaviour deviates from expectations. Solving these failures, i.e., identifying and fixing the issues causing the deviation, requires analysing complex logical and timing relationships between multiple signals. This process heavily relies on human expertise, and there is currently no automatic tool available to assist with it. Here, we present AssertSolver, an open-source Large Language Model (LLM) specifically designed for solving assertion failures. By leveraging synthetic training data and learning from error responses to challenging cases, AssertSolver achieves a bug-fixing pass@1 metric of 88.54% on our testbench, significantly outperforming OpenAI's o1-preview by up to 11.97%. We release our model and testbench for public access to encourage further research: https://github.com/SEU-ACAL/reproduce-AssertSolver-DAC-25.
title Insights from Rights and Wrongs: A Large Language Model for Solving Assertion Failures in RTL Design
topic Hardware Architecture
url https://arxiv.org/abs/2503.04057