A Meta-Level Learning Algorithm for Sequential Hyper-Parameter Space Reduction in AutoML
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2023
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866917569981579264 |
|---|---|
| author | Borboudakis, Giorgos Charonyktakis, Paulos Paraschakis, Konstantinos Tsamardinos, Ioannis |
| author_facet | Borboudakis, Giorgos Charonyktakis, Paulos Paraschakis, Konstantinos Tsamardinos, Ioannis |
| contents | AutoML platforms have numerous options for the algorithms to try for each step of the analysis, i.e., different possible algorithms for imputation, transformations, feature selection, and modelling. Finding the optimal combination of algorithms and hyper-parameter values is computationally expensive, as the number of combinations to explore leads to an exponential explosion of the space. In this paper, we present the Sequential Hyper-parameter Space Reduction (SHSR) algorithm that reduces the space for an AutoML tool with negligible drop in its predictive performance. SHSR is a meta-level learning algorithm that analyzes past runs of an AutoML tool on several datasets and learns which hyper-parameter values to filter out from consideration on a new dataset to analyze. SHSR is evaluated on 284 classification and 375 regression problems, showing an approximate 30% reduction in execution time with a performance drop of less than 0.1%. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2312_06305 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | A Meta-Level Learning Algorithm for Sequential Hyper-Parameter Space Reduction in AutoML Borboudakis, Giorgos Charonyktakis, Paulos Paraschakis, Konstantinos Tsamardinos, Ioannis Machine Learning Artificial Intelligence AutoML platforms have numerous options for the algorithms to try for each step of the analysis, i.e., different possible algorithms for imputation, transformations, feature selection, and modelling. Finding the optimal combination of algorithms and hyper-parameter values is computationally expensive, as the number of combinations to explore leads to an exponential explosion of the space. In this paper, we present the Sequential Hyper-parameter Space Reduction (SHSR) algorithm that reduces the space for an AutoML tool with negligible drop in its predictive performance. SHSR is a meta-level learning algorithm that analyzes past runs of an AutoML tool on several datasets and learns which hyper-parameter values to filter out from consideration on a new dataset to analyze. SHSR is evaluated on 284 classification and 375 regression problems, showing an approximate 30% reduction in execution time with a performance drop of less than 0.1%. |
| title | A Meta-Level Learning Algorithm for Sequential Hyper-Parameter Space Reduction in AutoML |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2312.06305 |