Towards a Comprehensive Human-Centred Evaluation Framework for Explainable AI
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2023
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866916796063285248 |
|---|---|
| author | Donoso-Guzmán, Ivania Ooge, Jeroen Parra, Denis Verbert, Katrien |
| author_facet | Donoso-Guzmán, Ivania Ooge, Jeroen Parra, Denis Verbert, Katrien |
| contents | While research on explainable AI (XAI) is booming and explanation techniques have proven promising in many application domains, standardised human-centred evaluation procedures are still missing. In addition, current evaluation procedures do not assess XAI methods holistically in the sense that they do not treat explanations' effects on humans as a complex user experience. To tackle this challenge, we propose to adapt the User-Centric Evaluation Framework used in recommender systems: we integrate explanation aspects, summarise explanation properties, indicate relations between them, and categorise metrics that measure these properties. With this comprehensive evaluation framework, we hope to contribute to the human-centred standardisation of XAI evaluation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2308_06274 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Towards a Comprehensive Human-Centred Evaluation Framework for Explainable AI Donoso-Guzmán, Ivania Ooge, Jeroen Parra, Denis Verbert, Katrien Human-Computer Interaction Artificial Intelligence While research on explainable AI (XAI) is booming and explanation techniques have proven promising in many application domains, standardised human-centred evaluation procedures are still missing. In addition, current evaluation procedures do not assess XAI methods holistically in the sense that they do not treat explanations' effects on humans as a complex user experience. To tackle this challenge, we propose to adapt the User-Centric Evaluation Framework used in recommender systems: we integrate explanation aspects, summarise explanation properties, indicate relations between them, and categorise metrics that measure these properties. With this comprehensive evaluation framework, we hope to contribute to the human-centred standardisation of XAI evaluation. |
| title | Towards a Comprehensive Human-Centred Evaluation Framework for Explainable AI |
| topic | Human-Computer Interaction Artificial Intelligence |
| url | https://arxiv.org/abs/2308.06274 |