Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2409.14839 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914582919905280 |
|---|---|
| author | Dorsch, John Moll, Maximilian |
| author_facet | Dorsch, John Moll, Maximilian |
| contents | In the context of AI decision support systems (AI-DSS), we argue that meeting the demands of ethical and explainable AI (XAI) is about developing AI-DSS to provide human decision-makers with three types of human-grounded explanations: reasons, counterfactuals, and confidence, an approach we refer to as the RCC approach. We begin by reviewing current empirical XAI literature that investigates the relationship between various methods for generating model explanations (e.g., LIME, SHAP, Anchors), the perceived trustworthiness of the model, and end-user accuracy. We demonstrate how current theories about what constitutes good human-grounded reasons either do not adequately explain this evidence or do not offer sound ethical advice for development. Thus, we offer a novel theory of human-machine interaction: the theory of epistemic quasi-partnerships (EQP). Finally, we motivate adopting EQP and demonstrate how it explains the empirical evidence, offers sound ethical advice, and entails adopting the RCC approach. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_14839 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Explainable and Human-Grounded AI for Decision Support Systems: The Theory of Epistemic Quasi-Partnerships Dorsch, John Moll, Maximilian Artificial Intelligence Emerging Technologies Human-Computer Interaction K.4.1; H.5.2; H.4.2; J.7; J.4 In the context of AI decision support systems (AI-DSS), we argue that meeting the demands of ethical and explainable AI (XAI) is about developing AI-DSS to provide human decision-makers with three types of human-grounded explanations: reasons, counterfactuals, and confidence, an approach we refer to as the RCC approach. We begin by reviewing current empirical XAI literature that investigates the relationship between various methods for generating model explanations (e.g., LIME, SHAP, Anchors), the perceived trustworthiness of the model, and end-user accuracy. We demonstrate how current theories about what constitutes good human-grounded reasons either do not adequately explain this evidence or do not offer sound ethical advice for development. Thus, we offer a novel theory of human-machine interaction: the theory of epistemic quasi-partnerships (EQP). Finally, we motivate adopting EQP and demonstrate how it explains the empirical evidence, offers sound ethical advice, and entails adopting the RCC approach. |
| title | Explainable and Human-Grounded AI for Decision Support Systems: The Theory of Epistemic Quasi-Partnerships |
| topic | Artificial Intelligence Emerging Technologies Human-Computer Interaction K.4.1; H.5.2; H.4.2; J.7; J.4 |
| url | https://arxiv.org/abs/2409.14839 |