Beyond explaining: XAI-based Adaptive Learning with SHAP Clustering for Energy Consumption Prediction
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917584524279808 |
|---|---|
| author | Clement, Tobias Nguyen, Hung Truong Thanh Kemmerzell, Nils Abdelaal, Mohamed Stjelja, Davor |
| author_facet | Clement, Tobias Nguyen, Hung Truong Thanh Kemmerzell, Nils Abdelaal, Mohamed Stjelja, Davor |
| contents | This paper presents an approach integrating explainable artificial intelligence (XAI) techniques with adaptive learning to enhance energy consumption prediction models, with a focus on handling data distribution shifts. Leveraging SHAP clustering, our method provides interpretable explanations for model predictions and uses these insights to adaptively refine the model, balancing model complexity with predictive performance. We introduce a three-stage process: (1) obtaining SHAP values to explain model predictions, (2) clustering SHAP values to identify distinct patterns and outliers, and (3) refining the model based on the derived SHAP clustering characteristics. Our approach mitigates overfitting and ensures robustness in handling data distribution shifts. We evaluate our method on a comprehensive dataset comprising energy consumption records of buildings, as well as two additional datasets to assess the transferability of our approach to other domains, regression, and classification problems. Our experiments demonstrate the effectiveness of our approach in both task types, resulting in improved predictive performance and interpretable model explanations. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_04982 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Beyond explaining: XAI-based Adaptive Learning with SHAP Clustering for Energy Consumption Prediction Clement, Tobias Nguyen, Hung Truong Thanh Kemmerzell, Nils Abdelaal, Mohamed Stjelja, Davor Machine Learning Databases This paper presents an approach integrating explainable artificial intelligence (XAI) techniques with adaptive learning to enhance energy consumption prediction models, with a focus on handling data distribution shifts. Leveraging SHAP clustering, our method provides interpretable explanations for model predictions and uses these insights to adaptively refine the model, balancing model complexity with predictive performance. We introduce a three-stage process: (1) obtaining SHAP values to explain model predictions, (2) clustering SHAP values to identify distinct patterns and outliers, and (3) refining the model based on the derived SHAP clustering characteristics. Our approach mitigates overfitting and ensures robustness in handling data distribution shifts. We evaluate our method on a comprehensive dataset comprising energy consumption records of buildings, as well as two additional datasets to assess the transferability of our approach to other domains, regression, and classification problems. Our experiments demonstrate the effectiveness of our approach in both task types, resulting in improved predictive performance and interpretable model explanations. |
| title | Beyond explaining: XAI-based Adaptive Learning with SHAP Clustering for Energy Consumption Prediction |
| topic | Machine Learning Databases |
| url | https://arxiv.org/abs/2402.04982 |