Quantifying Visual Properties of GAM Shape Plots: Impact on Perceived Cognitive Load and Interpretability
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866913709114261504 |
|---|---|
| author | Kruschel, Sven Bohlen, Lasse Rosenberger, Julian Zschech, Patrick Kraus, Mathias |
| author_facet | Kruschel, Sven Bohlen, Lasse Rosenberger, Julian Zschech, Patrick Kraus, Mathias |
| contents | Generalized Additive Models (GAMs) offer a balance between performance and interpretability in machine learning. The interpretability aspect of GAMs is expressed through shape plots, representing the model's decision-making process. However, the visual properties of these plots, e.g. number of kinks (number of local maxima and minima), can impact their complexity and the cognitive load imposed on the viewer, compromising interpretability. Our study, including 57 participants, investigates the relationship between the visual properties of GAM shape plots and cognitive load they induce. We quantify various visual properties of shape plots and evaluate their alignment with participants' perceived cognitive load, based on 144 plots. Our results indicate that the number of kinks metric is the most effective, explaining 86.4% of the variance in users' ratings. We develop a simple model based on number of kinks that provides a practical tool for predicting cognitive load, enabling the assessment of one aspect of GAM interpretability without direct user involvement. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_16870 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Quantifying Visual Properties of GAM Shape Plots: Impact on Perceived Cognitive Load and Interpretability Kruschel, Sven Bohlen, Lasse Rosenberger, Julian Zschech, Patrick Kraus, Mathias Human-Computer Interaction Machine Learning Generalized Additive Models (GAMs) offer a balance between performance and interpretability in machine learning. The interpretability aspect of GAMs is expressed through shape plots, representing the model's decision-making process. However, the visual properties of these plots, e.g. number of kinks (number of local maxima and minima), can impact their complexity and the cognitive load imposed on the viewer, compromising interpretability. Our study, including 57 participants, investigates the relationship between the visual properties of GAM shape plots and cognitive load they induce. We quantify various visual properties of shape plots and evaluate their alignment with participants' perceived cognitive load, based on 144 plots. Our results indicate that the number of kinks metric is the most effective, explaining 86.4% of the variance in users' ratings. We develop a simple model based on number of kinks that provides a practical tool for predicting cognitive load, enabling the assessment of one aspect of GAM interpretability without direct user involvement. |
| title | Quantifying Visual Properties of GAM Shape Plots: Impact on Perceived Cognitive Load and Interpretability |
| topic | Human-Computer Interaction Machine Learning |
| url | https://arxiv.org/abs/2409.16870 |