Performance is not enough: the story told by a Rashomon quartet
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2023
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866929493226029056 |
|---|---|
| author | Biecek, Przemyslaw Baniecki, Hubert Krzyzinski, Mateusz Cook, Dianne |
| author_facet | Biecek, Przemyslaw Baniecki, Hubert Krzyzinski, Mateusz Cook, Dianne |
| contents | The usual goal of supervised learning is to find the best model, the one that optimizes a particular performance measure. However, what if the explanation provided by this model is completely different from another model and different again from another model despite all having similarly good fit statistics? Is it possible that the equally effective models put the spotlight on different relationships in the data? Inspired by Anscombe's quartet, this paper introduces a Rashomon Quartet, i.e. a set of four models built on a synthetic dataset which have practically identical predictive performance. However, the visual exploration reveals distinct explanations of the relations in the data. This illustrative example aims to encourage the use of methods for model visualization to compare predictive models beyond their performance. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2302_13356 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Performance is not enough: the story told by a Rashomon quartet Biecek, Przemyslaw Baniecki, Hubert Krzyzinski, Mateusz Cook, Dianne Machine Learning Applications The usual goal of supervised learning is to find the best model, the one that optimizes a particular performance measure. However, what if the explanation provided by this model is completely different from another model and different again from another model despite all having similarly good fit statistics? Is it possible that the equally effective models put the spotlight on different relationships in the data? Inspired by Anscombe's quartet, this paper introduces a Rashomon Quartet, i.e. a set of four models built on a synthetic dataset which have practically identical predictive performance. However, the visual exploration reveals distinct explanations of the relations in the data. This illustrative example aims to encourage the use of methods for model visualization to compare predictive models beyond their performance. |
| title | Performance is not enough: the story told by a Rashomon quartet |
| topic | Machine Learning Applications |
| url | https://arxiv.org/abs/2302.13356 |