AKG kernel Agent: A Multi-Agent Framework for Cross-Platform Kernel Synthesis
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866915698304876544 |
|---|---|
| author | Du, Jinye Yuan, Quan Zhang, Zuyao Yi, Yanzhi Hu, Jiahui Chen, Wangyi Zhu, Yiyang Zheng, Qishui Zou, Wenxiang Chang, Xiangyu Zheng, Zuohe Ye, Zichun Liu, Chao Li, Shanni Zhang, Renwei Deng, Yiping Hu, Xinwei Jin, Xuefeng Zhao, Jie |
| author_facet | Du, Jinye Yuan, Quan Zhang, Zuyao Yi, Yanzhi Hu, Jiahui Chen, Wangyi Zhu, Yiyang Zheng, Qishui Zou, Wenxiang Chang, Xiangyu Zheng, Zuohe Ye, Zichun Liu, Chao Li, Shanni Zhang, Renwei Deng, Yiping Hu, Xinwei Jin, Xuefeng Zhao, Jie |
| contents | Modern AI models demand high-performance computation kernels. The growing complexity of LLMs, multimodal architectures, and recommendation systems, combined with techniques like sparsity and quantization, creates significant computational challenges. Moreover, frequent hardware updates and diverse chip architectures further complicate this landscape, requiring tailored kernel implementations for each platform. However, manual optimization cannot keep pace with these demands, creating a critical bottleneck in AI system development. Recent advances in LLM code generation capabilities have opened new possibilities for automating kernel development. In this work, we propose AKG kernel agent (AI-driven Kernel Generator), a multi-agent system that automates kernel generation, migration, and performance tuning. AKG kernel agent is designed to support multiple domain-specific languages (DSLs), including Triton, TileLang, CPP, and CUDA-C, enabling it to target different hardware backends while maintaining correctness and portability. The system's modular design allows rapid integration of new DSLs and hardware targets. When evaluated on KernelBench using Triton DSL across GPU and NPU backends, AKG kernel agent achieves an average speedup of 1.46$\times$ over PyTorch Eager baselines implementations, demonstrating its effectiveness in accelerating kernel development for modern AI workloads. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2512_23424 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | AKG kernel Agent: A Multi-Agent Framework for Cross-Platform Kernel Synthesis Du, Jinye Yuan, Quan Zhang, Zuyao Yi, Yanzhi Hu, Jiahui Chen, Wangyi Zhu, Yiyang Zheng, Qishui Zou, Wenxiang Chang, Xiangyu Zheng, Zuohe Ye, Zichun Liu, Chao Li, Shanni Zhang, Renwei Deng, Yiping Hu, Xinwei Jin, Xuefeng Zhao, Jie Artificial Intelligence Machine Learning Modern AI models demand high-performance computation kernels. The growing complexity of LLMs, multimodal architectures, and recommendation systems, combined with techniques like sparsity and quantization, creates significant computational challenges. Moreover, frequent hardware updates and diverse chip architectures further complicate this landscape, requiring tailored kernel implementations for each platform. However, manual optimization cannot keep pace with these demands, creating a critical bottleneck in AI system development. Recent advances in LLM code generation capabilities have opened new possibilities for automating kernel development. In this work, we propose AKG kernel agent (AI-driven Kernel Generator), a multi-agent system that automates kernel generation, migration, and performance tuning. AKG kernel agent is designed to support multiple domain-specific languages (DSLs), including Triton, TileLang, CPP, and CUDA-C, enabling it to target different hardware backends while maintaining correctness and portability. The system's modular design allows rapid integration of new DSLs and hardware targets. When evaluated on KernelBench using Triton DSL across GPU and NPU backends, AKG kernel agent achieves an average speedup of 1.46$\times$ over PyTorch Eager baselines implementations, demonstrating its effectiveness in accelerating kernel development for modern AI workloads. |
| title | AKG kernel Agent: A Multi-Agent Framework for Cross-Platform Kernel Synthesis |
| topic | Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2512.23424 |