Guardado en:
Detalles Bibliográficos
Autores principales: Yu, Yang, Zang, Peiyu, Tsai, Chi Hsu, Wu, Haiming, Shen, Yixin, Zhang, Jialing, Wang, Haoyu, Xiao, Zhiyou, Shi, Jingze, Luo, Yuyu, Zhang, Wentao, Men, Chunlei, Liu, Guang, Lin, Yonghua
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:https://arxiv.org/abs/2601.15727
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914279729397760
author Yu, Yang
Zang, Peiyu
Tsai, Chi Hsu
Wu, Haiming
Shen, Yixin
Zhang, Jialing
Wang, Haoyu
Xiao, Zhiyou
Shi, Jingze
Luo, Yuyu
Zhang, Wentao
Men, Chunlei
Liu, Guang
Lin, Yonghua
author_facet Yu, Yang
Zang, Peiyu
Tsai, Chi Hsu
Wu, Haiming
Shen, Yixin
Zhang, Jialing
Wang, Haoyu
Xiao, Zhiyou
Shi, Jingze
Luo, Yuyu
Zhang, Wentao
Men, Chunlei
Liu, Guang
Lin, Yonghua
contents The performance of modern AI systems is fundamentally constrained by the quality of their underlying kernels, which translate high-level algorithmic semantics into low-level hardware operations. Achieving near-optimal kernels requires expert-level understanding of hardware architectures and programming models, making kernel engineering a critical but notoriously time-consuming and non-scalable process. Recent advances in large language models (LLMs) and LLM-based agents have opened new possibilities for automating kernel generation and optimization. LLMs are well-suited to compress expert-level kernel knowledge that is difficult to formalize, while agentic systems further enable scalable optimization by casting kernel development as an iterative, feedback-driven loop. Rapid progress has been made in this area. However, the field remains fragmented, lacking a systematic perspective for LLM-driven kernel generation. This survey addresses this gap by providing a structured overview of existing approaches, spanning LLM-based approaches and agentic optimization workflows, and systematically compiling the datasets and benchmarks that underpin learning and evaluation in this domain. Moreover, key open challenges and future research directions are further outlined, aiming to establish a comprehensive reference for the next generation of automated kernel optimization. To keep track of this field, we maintain an open-source GitHub repository at https://github.com/flagos-ai/awesome-LLM-driven-kernel-generation.
format Preprint
id arxiv_https___arxiv_org_abs_2601_15727
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Towards Automated Kernel Generation in the Era of LLMs
Yu, Yang
Zang, Peiyu
Tsai, Chi Hsu
Wu, Haiming
Shen, Yixin
Zhang, Jialing
Wang, Haoyu
Xiao, Zhiyou
Shi, Jingze
Luo, Yuyu
Zhang, Wentao
Men, Chunlei
Liu, Guang
Lin, Yonghua
Machine Learning
Computation and Language
The performance of modern AI systems is fundamentally constrained by the quality of their underlying kernels, which translate high-level algorithmic semantics into low-level hardware operations. Achieving near-optimal kernels requires expert-level understanding of hardware architectures and programming models, making kernel engineering a critical but notoriously time-consuming and non-scalable process. Recent advances in large language models (LLMs) and LLM-based agents have opened new possibilities for automating kernel generation and optimization. LLMs are well-suited to compress expert-level kernel knowledge that is difficult to formalize, while agentic systems further enable scalable optimization by casting kernel development as an iterative, feedback-driven loop. Rapid progress has been made in this area. However, the field remains fragmented, lacking a systematic perspective for LLM-driven kernel generation. This survey addresses this gap by providing a structured overview of existing approaches, spanning LLM-based approaches and agentic optimization workflows, and systematically compiling the datasets and benchmarks that underpin learning and evaluation in this domain. Moreover, key open challenges and future research directions are further outlined, aiming to establish a comprehensive reference for the next generation of automated kernel optimization. To keep track of this field, we maintain an open-source GitHub repository at https://github.com/flagos-ai/awesome-LLM-driven-kernel-generation.
title Towards Automated Kernel Generation in the Era of LLMs
topic Machine Learning
Computation and Language
url https://arxiv.org/abs/2601.15727