MetaStackVis: Visually-Assisted Performance Evaluation of Metamodels
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2022
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914760024391680 |
|---|---|
| author | Ploshchik, Ilya Chatzimparmpas, Angelos Kerren, Andreas |
| author_facet | Ploshchik, Ilya Chatzimparmpas, Angelos Kerren, Andreas |
| contents | Stacking (or stacked generalization) is an ensemble learning method with one main distinctiveness from the rest: even though several base models are trained on the original data set, their predictions are further used as input data for one or more metamodels arranged in at least one extra layer. Composing a stack of models can produce high-performance outcomes, but it usually involves a trial-and-error process. Therefore, our previously developed visual analytics system, StackGenVis, was mainly designed to assist users in choosing a set of top-performing and diverse models by measuring their predictive performance. However, it only employs a single logistic regression metamodel. In this paper, we investigate the impact of alternative metamodels on the performance of stacking ensembles using a novel visualization tool, called MetaStackVis. Our interactive tool helps users to visually explore different singular and pairs of metamodels according to their predictive probabilities and multiple validation metrics, as well as their ability to predict specific problematic data instances. MetaStackVis was evaluated with a usage scenario based on a medical data set and via expert interviews. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2212_03539 |
| institution | arXiv |
| publishDate | 2022 |
| record_format | arxiv |
| spellingShingle | MetaStackVis: Visually-Assisted Performance Evaluation of Metamodels Ploshchik, Ilya Chatzimparmpas, Angelos Kerren, Andreas Machine Learning Human-Computer Interaction Stacking (or stacked generalization) is an ensemble learning method with one main distinctiveness from the rest: even though several base models are trained on the original data set, their predictions are further used as input data for one or more metamodels arranged in at least one extra layer. Composing a stack of models can produce high-performance outcomes, but it usually involves a trial-and-error process. Therefore, our previously developed visual analytics system, StackGenVis, was mainly designed to assist users in choosing a set of top-performing and diverse models by measuring their predictive performance. However, it only employs a single logistic regression metamodel. In this paper, we investigate the impact of alternative metamodels on the performance of stacking ensembles using a novel visualization tool, called MetaStackVis. Our interactive tool helps users to visually explore different singular and pairs of metamodels according to their predictive probabilities and multiple validation metrics, as well as their ability to predict specific problematic data instances. MetaStackVis was evaluated with a usage scenario based on a medical data set and via expert interviews. |
| title | MetaStackVis: Visually-Assisted Performance Evaluation of Metamodels |
| topic | Machine Learning Human-Computer Interaction |
| url | https://arxiv.org/abs/2212.03539 |