ChipMATE: Multi-Agent Training via Reinforcement Learning for Enhanced RTL Generation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yu, Zhongkai, Lin, Yichen, Zhou, Chenyang, Zhang, Yuwei, Zhou, Kun, Cui, Junxia, Ye, Haotian, Hu, Zhengding, Pan, Zaifeng, Wang, Ruiyi, Zhao, Yujie, Zhang, Hejia, Shang, Jingbo, Zhao, Jishen, Ding, Yufei
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917488839622656
author Yu, Zhongkai
Lin, Yichen
Zhou, Chenyang
Zhang, Yuwei
Zhou, Kun
Cui, Junxia
Ye, Haotian
Hu, Zhengding
Pan, Zaifeng
Wang, Ruiyi
Zhao, Yujie
Zhang, Hejia
Shang, Jingbo
Zhao, Jishen
Ding, Yufei
author_facet Yu, Zhongkai
Lin, Yichen
Zhou, Chenyang
Zhang, Yuwei
Zhou, Kun
Cui, Junxia
Ye, Haotian
Hu, Zhengding
Pan, Zaifeng
Wang, Ruiyi
Zhao, Yujie
Zhang, Hejia
Shang, Jingbo
Zhao, Jishen
Ding, Yufei
contents Existing API-based agentic systems for RTL code generation are fundamentally misaligned with industrial practice: they assume a golden testbench is available at generation time, rely on closed-source APIs incompatible with chip vendors' air-gapped security requirements, and cannot be trained on vendors' proprietary RTL codebases, leaving valuable internal data unused. Recent self-trained models address the deployment constraint but remain single-turn generators that overlook the critical role of verification in real industrial flows. To bridge these gaps, we present ChipMATE, the first self-trained multi-agent framework for RTL generation. Inspired by industrial practice where correctness emerges from cross-comparison between independently written RTL modules and reference models, ChipMATE pairs a Verilog agent with a Python reference-model agent that mutually verify each other's outputs without any golden oracle. We design a backtrack-based inference workflow to prevent error propagation across turns, and a two-stage training pipeline that first trains each agent individually to saturate its code-generation capability, then trains the team jointly to collaborate effectively. To support the training, we further build a hybrid data-generation framework that produces 64.4K high-quality reference model training samples. ChipMATE achieves 75.0\% and 80.1\% pass@1 on VerilogEval V2 with 4B and 9B base models, outperforming all existing self-trained models and even DeepSeek V4 with 1600B parameters. Our code and model weights are publicly available in https://github.com/zhongkaiyu/ChipMATE.
format Preprint
id arxiv_https___arxiv_org_abs_2605_12857
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle ChipMATE: Multi-Agent Training via Reinforcement Learning for Enhanced RTL Generation
Yu, Zhongkai
Lin, Yichen
Zhou, Chenyang
Zhang, Yuwei
Zhou, Kun
Cui, Junxia
Ye, Haotian
Hu, Zhengding
Pan, Zaifeng
Wang, Ruiyi
Zhao, Yujie
Zhang, Hejia
Shang, Jingbo
Zhao, Jishen
Ding, Yufei
Multiagent Systems
Artificial Intelligence
Hardware Architecture
Machine Learning
Existing API-based agentic systems for RTL code generation are fundamentally misaligned with industrial practice: they assume a golden testbench is available at generation time, rely on closed-source APIs incompatible with chip vendors' air-gapped security requirements, and cannot be trained on vendors' proprietary RTL codebases, leaving valuable internal data unused. Recent self-trained models address the deployment constraint but remain single-turn generators that overlook the critical role of verification in real industrial flows. To bridge these gaps, we present ChipMATE, the first self-trained multi-agent framework for RTL generation. Inspired by industrial practice where correctness emerges from cross-comparison between independently written RTL modules and reference models, ChipMATE pairs a Verilog agent with a Python reference-model agent that mutually verify each other's outputs without any golden oracle. We design a backtrack-based inference workflow to prevent error propagation across turns, and a two-stage training pipeline that first trains each agent individually to saturate its code-generation capability, then trains the team jointly to collaborate effectively. To support the training, we further build a hybrid data-generation framework that produces 64.4K high-quality reference model training samples. ChipMATE achieves 75.0\% and 80.1\% pass@1 on VerilogEval V2 with 4B and 9B base models, outperforming all existing self-trained models and even DeepSeek V4 with 1600B parameters. Our code and model weights are publicly available in https://github.com/zhongkaiyu/ChipMATE.
title ChipMATE: Multi-Agent Training via Reinforcement Learning for Enhanced RTL Generation
topic Multiagent Systems
Artificial Intelligence
Hardware Architecture
Machine Learning
url https://arxiv.org/abs/2605.12857