Enregistré dans:
Détails bibliographiques
Auteurs principaux: Cha, JooHyoung, Lee, Munyoung, Kwon, Jinse, Lee, Jubin, Lee, Jemin, Kwon, Yongin
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:https://arxiv.org/abs/2411.10764
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866929593705824256
author Cha, JooHyoung
Lee, Munyoung
Kwon, Jinse
Lee, Jubin
Lee, Jemin
Kwon, Yongin
author_facet Cha, JooHyoung
Lee, Munyoung
Kwon, Jinse
Lee, Jubin
Lee, Jemin
Kwon, Yongin
contents The increasing complexity of deep learning models necessitates specialized hardware and software optimizations, particularly for deep learning accelerators. Existing autotuning methods often suffer from prolonged tuning times due to profiling invalid configurations, which can cause runtime errors. We introduce ML$^2$Tuner, a multi-level machine learning tuning technique that enhances autotuning efficiency by incorporating a validity prediction model to filter out invalid configurations and an advanced performance prediction model utilizing hidden features from the compilation process. Experimental results on an extended VTA accelerator demonstrate that ML$^2$Tuner achieves equivalent performance improvements using only 12.3% of the samples required with a similar approach as TVM and reduces invalid profiling attempts by an average of 60.8%, Highlighting its potential to enhance autotuning performance by filtering out invalid configurations
format Preprint
id arxiv_https___arxiv_org_abs_2411_10764
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle ML$^2$Tuner: Efficient Code Tuning via Multi-Level Machine Learning Models
Cha, JooHyoung
Lee, Munyoung
Kwon, Jinse
Lee, Jubin
Lee, Jemin
Kwon, Yongin
Machine Learning
The increasing complexity of deep learning models necessitates specialized hardware and software optimizations, particularly for deep learning accelerators. Existing autotuning methods often suffer from prolonged tuning times due to profiling invalid configurations, which can cause runtime errors. We introduce ML$^2$Tuner, a multi-level machine learning tuning technique that enhances autotuning efficiency by incorporating a validity prediction model to filter out invalid configurations and an advanced performance prediction model utilizing hidden features from the compilation process. Experimental results on an extended VTA accelerator demonstrate that ML$^2$Tuner achieves equivalent performance improvements using only 12.3% of the samples required with a similar approach as TVM and reduces invalid profiling attempts by an average of 60.8%, Highlighting its potential to enhance autotuning performance by filtering out invalid configurations
title ML$^2$Tuner: Efficient Code Tuning via Multi-Level Machine Learning Models
topic Machine Learning
url https://arxiv.org/abs/2411.10764